The Rag GTPases (Rags) recruit mTORC1 to the lysosomal membrane in response to nutrients, where it is then activated in response to energy and growth factor availability. The lysosomal folliculin (FLCN) complex (LFC) consists of the inactive Rag dimer, the pentameric scaffold Ragulator, and the FLCN:FNIP2 (FLCN-interacting protein 2) GTPase activating protein (GAP) complex, and prevents Rag dimer activation during amino acid starvation. How the LFC is disassembled upon amino acid refeeding is an outstanding question. Here we show that the cytoplasmic tail of the human lysosomal solute carrier family 38 member 9 (SLC38A9) destabilizes the LFC and thereby triggers GAP activity of FLCN:FNIP2 toward RagC. We present the cryo-EM structures of Rags in complex with their lysosomal anchor complex Ragulator and the cytoplasmic tail of SLC38A9 in the pre- and post-GTP hydrolysis state of RagC, which explain how SLC38A9 destabilizes the LFC and so promotes Rag dimer activation.