Breast cancers that express estrogen receptor alpha (ERα+) constitute the majority of breast tumors. Estrogen is a major driver of their growth, and targeting ER-mediated signals is a largely successful primary therapeutic strategy. Nonetheless, ERα+ tumors also result in the most breast cancer mortalities. Other factors, including altered characteristics of the extracellular matrix such as density and orientation and consequences for estrogen crosstalk with other hormones such as prolactin (PRL), may contribute to these poor outcomes. Here we employed defined three dimensional low density/compliant and high density/stiff collagen-I matrices to investigate the effects on 17β-estradiol (E2) activity and PRL/E2 interactions in two well-characterized ERα+/PRLR+ luminal breast cancer cell lines in vitro. We demonstrate that matrix density modulated E2-induced transcripts, but did not alter the growth response. However, matrix density was a potent determinant of the behavioral outcomes of PRL/E2 crosstalk. High density/stiff matrices enhanced PRL/E2-induced growth mediated by increased activation of Src family kinases and insensitivity to the estrogen antagonist, 4-hydroxytamoxifen. It also permitted these hormones in combination to drive invasion and modify the alignment of collagen fibers. In contrast, low density/compliant matrices allowed modest if any cooperation between E2 and PRL to growth and did not permit hormone-induced invasion or collagen reorientation. Our studies demonstrate the power of matrix density to determine the outcomes of hormone actions and suggest that stiff matrices are potent collaborators of estrogen and PRL in progression of ERα+ breast cancer. Our evidence for bidirectional interactions between these hormones and the extracellular matrix provides novel insights into the regulation of the microenvironment of ERα+ breast cancer and suggests new therapeutic approaches.