SHP-1 is an SH2-containing cytoplasmic tyrosine phosphatase that is widely distributed in cells of the hematopoietic system. SHP-1 plays an important role in the signal transduction of many cytokine receptors, including the receptor for erythropoietin, by associating via its SH2 domains to the receptors and dephosphorylating key substrates. Recent studies have suggested that SHP-1 regulates the function of Jak family tyrosine kinases, as shown by its constitutive association with the Tyk2 kinase and the hyperphosphorylation of Jak kinases in the motheaten cells that lack functional SHP-1. We have examined the interactions of SHP-1 with two tyrosine kinases activated during engagement of the erythropoietin receptor, the Janus family kinase Jak-2 and the c-fps/fes kinase. Immunoblotting studies with extracts from mouse hematopoietic cells demonstrated that Jak2, but not c-fes, was present in anti-SHP-1 immunoprecipitates, suggesting that SHP-1 selectively associates with Jak2 in vivo. Consistent with this, when SHP-1 was coexpressed with these kinases in Cos-7 cells, it associated with and dephosphorylated Jak2 but not c-fes. Transient cotransfection of truncated forms of SHP-1 with Jak2 demonstrated that the SHP-1-Jak2 interaction is direct and is mediated by a novel binding activity present in the N terminus of SHP-1, independently of SH2 domain-phosphotyrosine interaction. Such SHP-1-Jak2 interaction resulted in induction of the enzymatic activity of the phosphatase in in vitro protein tyrosine phosphatase assays. Interestingly, association of the SH2n domain of SHP-1 with the tyrosine phosphorylated erythropoietin receptor modestly potentiated but was not essential for SHP-1-mediated dephosphorylation of Jak2 and had no effect on c-fes phosphorylation. These data indicate that the main mechanism for regulation of Jak2 phosphorylation by SHP-1 involves a direct, SH2-independent interaction with Jak2 and suggest the existence of similar mechanisms for other members of the Jak family of kinases. They also suggest that such interactions may provide one of the mechanisms that control SHP-1 substrate specificity.