Human and simian immunodeficiency virus (HIV/SIV) Tat proteins are specified by two coding exons. Tat functions in the transcription of primate lentiviruses. A plethora of in vitro data currently suggests that the second coding exon of Tat is largely devoid of function. However, whether the second exon of Tat contributes functionally to viral pathogenesis in vivo remains unknown. To address this question directly, we compared infection of rhesus macaques with an SIV, engineered to express only the first coding exon of Tat (SIVtat1ex), to counterpart infection with wild-type SIVmac239 virus, which expresses the full 2-exon Tat. This comparison showed that the second coding exon of Tat contributes to chronic SIV replication in vivo. Interestingly, in macaques, we observed a cytotoxic T lymphocytes (CTL) response to the second coding exon of Tat, which appears to durably control SIV replication. When SIV mutated in an attempt to escape this second Tat-exon-CTL, the resulting virus was less replicatively fit and failed to populate the host in vivo. Our study provides the first evidence that the second coding exon in Tat embodies an important function for in vivo replication. We suggest the second coding exon of Tat as an example of a functionally constrained "epitope" whose elicited CTL response cannot be escaped by virus mutation without producing a virus that replicates poorly in vivo.