The process of transcription initiation and elongation are primary points of control in the regulation of gene expression. Although biochemical studies have uncovered the mechanisms involved in controlling transcription at each step, how these mechanisms manifest in vivo at the level of individual genes is still unclear. Recent experimental advances have enabled single-cell measurements of RNA polymerase (RNAP) molecules engaged in the process of transcribing a gene of interest. In this article, we use Gillespie simulations to show that measurements of cell-to-cell variability of RNAP numbers and interpolymerase distances can reveal the prevailing mode of regulation of a given gene. Mechanisms of regulation at each step, from initiation to elongation dynamics, produce qualitatively distinct signatures, which can further be used to discern between them. Most intriguingly, depending on the initiation kinetics, stochastic elongation can either enhance or suppress cell-to-cell variability at the RNAP level. To demonstrate the value of this framework, we analyze RNAP number distribution data for ribosomal genes in Saccharomyces cerevisiae from three previously published studies and show that this approach provides crucial mechanistic insights into the transcriptional regulation of these genes. reserved.