The population-based case-control study design is perhaps one of, if not the most, commonly used designs for investigating the genetic and environmental contributions to disease risk in epidemiological studies. Ages at onset and disease status of family members are routinely and systematically collected from the participants in this design. Considering age at onset in relatives as an outcome, this article is focused on using the family history information to obtain the hazard function, i.e., age-dependent penetrance function, of candidate genes from case-control studies. A frailty-model-based approach is proposed to accommodate the shared risk among family members that is not accounted for by observed risk factors. This approach is further extended to accommodate missing genotypes in family members and a two-phase case-control sampling design. Simulation results show that the proposed method performs well in realistic settings. Finally, a population-based two-phase case-control breast cancer study of the BRCA1 gene is used to illustrate the method.