The aim of the present study was to explore links between dietary habits and biomarkers of systemic inflammation in older adults. In a sample of 233 community-dwelling older adults (65–70 years), dietary habits were assessed by a food-frequency questionnaire. Physical activity and sedentary time were assessed using accelerometry. Inflammatory biomarkers were assessed from blood samples. The results showed that intake of vegetables was inversely related to levels of systemic inflammation (p < 0.05), independently of physical activity level. The present study strengthens public health efforts to promote vegetable-rich diets in older adults to mitigate age-related systemic inflammation.