Our previous research suggests an association between a low number of teeth and increased risk of dementia. The aim of the present study was to determine if a low number of teeth is specifically related to memory decline as evidenced by low Delayed Word Recall scores. In addition, we examined the combined effect of a low number of teeth and the apolipoprotein E epsilon4 allele on Delayed Word Recall scores. We hypothesized that the scores of those who had the allele and a low number of teeth (0-9) would decline more rapidly over time than those participants with a greater number of teeth who lacked the allele. We found that individuals with both risk factors (the allele and fewer teeth) had lower Delayed Word Recall scores at the first examination and declined more quickly compared with participants with neither of these risk factors or with either risk factor alone.