Brain maintenance has been identified as a major determinant of successful memory aging. However, the extent to which brain maintenance in support of successful memory aging is specific to memory-related brain regions or forms part of a brain-wide phenomenon is unresolved. Here, we used longitudinal brain-wide gray matter MRI volumes in 262 healthy participants aged 55 to 80 years at baseline to investigate separable dimensions of brain atrophy, and explored the links of these dimensions to different dimensions of cognitive change. We statistically adjusted for common causes of change in both brain and cognition to reveal a potentially unique signature of brain maintenance related to successful memory aging. Critically, medial temporal lobe (MTL)/hippocampal change and episodic memory change were characterized by unique, residual variance beyond general factors of change in brain and cognition, and a reliable association between these two residualized variables was established (r = 0.36, p < 0.01). The present study is the first to provide solid evidence for a specific association between changes in (MTL)/hippocampus and episodic memory in normal human aging. We conclude that hippocampus-specific brain maintenance relates to the specific preservation of episodic memory in old age, in line with the notion that brain maintenance operates at both general and domain-specific levels.