The small RNA payload of mammalian sperm undergoes dramatic remodeling during development, as several waves of microRNAs and tRNA fragments are shipped to sperm during post-testicular maturation in the epididymis. Here, we take advantage of this developmental process to probe the function of the sperm RNA payload in preimplantation development. We generated zygotes via intracytoplasmic sperm injection (ICSI) using sperm obtained from the proximal (caput) vs. distal (cauda) epididymis, then characterized development of the resulting embryos. Embryos generated using caput sperm significantly overexpress multiple regulatory factors throughout preimplantation development, and subsequently implant inefficiently and fail soon after implantation. Remarkably, microinjection of purified cauda-specific small RNAs into caput-derived embryos not only completely rescued preimplantation molecular defects, but also suppressed the postimplantation embryonic lethality phenotype. These findings reveal an essential role for small RNA remodeling during post-testicular maturation of mammalian sperm, and identify a specific preimplantation gene expression program responsive to sperm-delivered microRNAs.