Adipose tissue inflammation, characterized by augmented infiltration and altered polarization of macrophages, contributes to insulin resistance and its associated metabolic diseases. The NAD⁺‐dependent deacetylase SIRT1 serves as a guardian against metabolic disorders in multiple tissues. To dissect the roles of SIRT1 in adipose tissues, metabolic phenotypes of mice with selective ablation of SIRT1 in adipocytes and myeloid cells were monitored. Compared to myeloid‐specific SIRT1 depletion, mice with adipocyte‐selective deletion of SIRT1 are more susceptible to diet‐induced insulin resistance. The phenotypic changes in adipocyte‐selective SIRT1 knockout mice are associated with an increased number of adipose‐resident macrophages and their polarization toward the pro‐inflammatory M1 subtype. Mechanistically, SIRT1 in adipocytes modulates expression and secretion of several adipokines, including adiponectin, MCP‐1, and interleukin 4, which in turn alters recruitment and polarization of the macrophages in adipose tissues. In adipocytes, SIRT1 deacetylates the transcription factor NFATc1 and thereby enhances the binding of NFATc1 to the Il4 gene promoter. These findings suggest that adipocyte SIRT1 controls systemic glucose homeostasis and insulin sensitivity via the cross talk with adipose‐resident macrophages.