Document Type
Peer-Reviewed Article
Publication Date
11-1995
Abstract
People tend not to have perfect memories when it comes to learning, or to anything else for that matter. Most formal studies of learning, however, assume a perfect memory. Some approaches have restricted the number of items that could be retained. We introduce a complexity theoretic accounting of memory utilization by learning machines. In our new model, memory is measured in bits as a function of the size of the input. There is a hierarchy of learnability based on increasing memory allotment. The lower bound results are proved using an unusual combination of pumping and mutual recursion theorem arguments. For technical reasons, it was necessary to consider two types of memory: long and short term.
Recommended Citation
Freivalds, R., Kinber, E., & Smith, C. H. (1995). On the impact of forgetting on learning machines. Journal of the Association for Computing Machinery, 42(6), 1146-1168.
