A recently identified variant within the fat mass and obesity-associated (FTO) gene is carried by 46% of Western Europeans and is associated with an ~1.2 kg higher weight, on average, in adults and an ~1 cm greater waist circumference. With >1 billion overweight and 300 million obese persons worldwide, it is crucial to understand the implications of carrying this very common allele for the health of our aging population. FTO is highly expressed in the brain and elevated body mass index (BMI) is associated with brain atrophy, but it is unknown how the obesity-associated risk allele affects human brain structure. We therefore generated 3D maps of regional brain volume differences in 206 healthy elderly subjects scanned with MRI and genotyped as part of the Alzheimer's Disease Neuroimaging Initiative. We found a pattern of systematic brain volume deficits in carriers of the obesity-associated risk allele versus noncarriers. Relative to structure volumes in the mean template, FTO risk allele carriers versus noncarriers had an average brain volume difference of ~8% in the frontal lobes and 12% in the occipital lobes—these regions also showed significant volume deficits in subjects with higher BMI. These brain differences were not attributable to differences in cholesterol levels, hypertension, or the volume of white matter hyperintensities; which were not detectably higher in FTO risk allele carriers versus noncarriers. These brain maps reveal that a commonly carried susceptibility allele for obesity is associated with structural brain atrophy, with implications for the health of the elderly.