Recent studies have shown that chromosomes in a range of organisms are compartmentalized in different types of chromatin domains. In mammals, chromosomes form compartments that are composed of smaller Topologically Associating Domains (TADs). TADs are thought to represent functional domains of gene regulation but much is still unknown about the mechanisms of their formation and how they exert their regulatory effect on embedded genes. Further, similar domains have been detected in other organisms, including flies, worms, fungi and bacteria. Although in all these cases these domains appear similar as detected by 3C-based methods, their biology appears to be quite distinct with differences in the protein complexes involved in their formation and differences in their internal organization. Here we outline our current understanding of such domains in different organisms and their roles in gene regulation.