The emergence of drug resistance of the BCR-ABL kinase inhibitor imatinib, especially toward the T315I gatekeeper mutation, poses a great challenge to targeted therapy in treating chronic myeloid leukemia (CML) patients. To discover novel inhibitors against drug-resistant CML bearing T315I mutation, we applied a physics-based hierarchical virtual screening approach to dock a large chemical library against ATP binding pockets of both wild-type (WT) and T315I mutant ABL kinases in a combinatorial fashion. This strategy automatically resulted in 87 compounds satisfying structural and energetic criteria of both WT and T315I mutant kinases. Among them, nine compounds, which share a common thiophene-based scaffold and adopt similar binding poses, were chosen for experimental testing and one of them was shown to have low micromolar inhibition activities against both WT and mutant ABL kinases. Structure-activity relationship analysis with a series of structural modifications based on 2-acylaminothiophene-3-carboxamide scaffold supports our predicted binding mode. Interestingly, the same chemical scaffold was also enriched in our previous virtual screening campaign against colchicine site of microtubules using the same computational protocol, which suggests our virtual screening strategy is capable of discovering small-molecule ligands targeting distinct protein binding sites without sharing any sequential and structural similarity. Furthermore, the multitarget inhibition activity of this class of compounds was assessed in cellular experiments. We expect that the 2-acylaminothiophene-3-carboxamide scaffold may serve as a promising starting point for developing multitarget inhibitors in cancer treatment by targeting both kinases and microtubules.