The outcome of an encounter with Mycobacterium tuberculosis (Mtb) depends on the pathogen’s ability to adapt to the heterogeneous immune response of the host. Understanding this interplay has proven difficult, largely because experimentally tractable small animal models do not recapitulate the heterogenous disease observed in natural infections. We leveraged the genetically diverse Collaborative Cross (CC) mouse panel in conjunction with a library of Mtb mutants to associate bacterial genetic requirements with host genetics and immunity. We report that CC strains vary dramatically in their susceptibility to infection and represent reproducible models of qualitatively distinct immune states. Global analysis of Mtb mutant fitness across the CC panel revealed that a large fraction of the pathogen’s genome is necessary for adaptation to specific host microenvironments. Both immunological and bacterial traits were associated with genetic variants distributed across the mouse genome, elucidating the complex genetic landscape that underlies host-pathogen interactions in a diverse population.