While several clathrin-independent endocytic processes have been described so far, their biological relevance often remains elusive, especially in pathophysiological contexts such as cancer. In this study, we find that the tumor marker CD166/ALCAM (Activated Leukocyte Cell Adhesion Molecule) is a clathrin-independent cargo. We show that endophilin-A3-but neither A1 nor A2 isoforms-functionally associates with CD166-containing early endocytic carriers and physically interacts with the cargo. Our data further demonstrates that the three endophilin-A isoforms control the uptake of distinct subsets of cargoes. In addition, we provide strong evidence that the construction of endocytic sites from which CD166 is taken up in an endophilin-A3-dependent manner is driven by extracellular galectin-8. Taken together, our data reveal the existence of a previously uncharacterized clathrin-independent endocytic modality, that modulates the abundance of CD166 at the cell surface, and regulates adhesive and migratory properties of cancer cells.