Growing older often comes with the expectation of memory loss. By age 80, the average person recalls far fewer words on standard memory tests than they did in middle age.