All humans are continuously exposed to inhaled Aspergillus conidia, yet healthy hosts clear the organism without developing disease and without the development of antibody- or cell-mediated acquired immunity to this organism. This suggests that for most healthy humans, innate immunity is sufficient to clear the organism. A failure of these defenses results in a uniquely diverse set of illnesses caused by Aspergillus species, which includes diseases caused by the colonization of the respiratory tract, invasive infection, and hypersensitivity. A key concept in immune responses to Aspergillus species is that the susceptibilities of the host determine the morphological form, antigenic structure, and physical location of the fungus. In this review, we summarize the current literature on the multiple layers of innate defenses against Aspergillus species that dictate the outcome of this host-microbe interaction.