The associations of SNPs in TOX3 gene with breast cancer risk were investigated by some Genome-wide association studies and epidemiological studies, but the study results were contradictory. To derive a more precise estimate of the associations, we conducted a meta-analysis. ORs with 95% CI were used to assess the strength of association between TOX3 polymorphisms and breast cancer risk in fixed or random effect model. A total of 37 publications with 97275 cases and 128686 controls were identified. We observed that the rs3803662 C > T, rs12443621 A > G and rs8051542 C > T were all correlated with increased risk of breast cancer. In the stratified analyses by ethnicity, significantly elevated risk was detected for all genetic models of the three SNPs in Caucasians. In Asian populations, there were significant associations of rs3803662 and rs8051542 with breast cancer risk. Whereas there was no evidence for statistical significant association between the three SNPs and breast cancer risk in Africans. Additionally, we observed different associations of rs3803662 with breast cancer risk based on different ER subtype and BRCA1/BRCA2 mutation carriers. In conclusion, the meta-analysis suggested that three SNPs in TOX3 were significantly associated with breast cancer risk in different populations.