To determine the influence of asymptomatic genital viral infections on the cellular components of semen and blood, we evaluated the associations between the numbers and activation statuses of CD4+ and CD8+ T lymphocytes in both compartments and the seminal levels of cytomegalovirus (CMV), herpes simplex virus (HSV), and human immunodeficiency virus 1 (HIV). Paired blood and semen samples were collected from 36 HIV-infected antiretroviral-naïve individuals and from 40 HIV-uninfected participants. We performed multiparameter flow cytometry analysis (CD45, CD45RA, CD3, CD4, CD8, and CD38) of seminal and blood cellular components and measured HIV RNA and CMV and HSV DNA levels in seminal and blood plasma by real-time PCR. Compared to HIV-uninfected participants, in the seminal compartment HIV-infected participants had higher levels of CMV (P < 0.05), higher numbers of total CD3+ (P < 0.01) and CD8+ subset (P < 0.01) T lymphocytes, and higher CD4+ and CD8+ T lymphocyte activation (RA-CD38+) (P < 0.01). Seminal CMV levels positively correlated with absolute numbers of CD4+ and CD8+ T cells in semen (P < 0.05) and with the activation status of CD4+ T cells in semen and in blood (P < 0.01). HIV levels in semen (P < 0.05) and blood (P < 0.01) were positively associated with T-cell activation in blood. Activation of CD8+ T cells in blood remained an independent predictor of HIV levels in semen in multivariate analysis. The virologic milieu in the male genital tract strongly influences the recruitment and activation of immune cells in semen and may also modulate T-cell immune activation in blood. These factors likely influence replication dynamics, sexual transmission risk, and disease outcomes for all three viruses.