Discovery of potent and novel smoothened antagonists via structure-based virtual screening and biological assays

The Hedgehog (Hh) signaling pathway plays a critical role in controlling patterning, growth and cell migration during embryonic development. Aberrant activation of Hh signaling has been linked to tumorigenesis in various cancers, such as basal cell carcinoma (BCC) and medulloblastoma. As a key member of the Hh pathway, the Smoothened (Smo) receptor, a member of the G protein-coupled receptor (GPCR) family, has emerged as an attractive therapeutic target for the treatment and prevention of human cancers. The recent determination of several crystal structures of Smo in complex with different antagonists offers the possibility to perform structure-based virtual screening for discovering potent Smo antagonists with distinct chemical scaffolds. In this study, based on the two Smo crystal complexes with the best capacity to distinguish the known Smo antagonists from decoys, the molecular docking-based virtual screening was conducted to identify promising Smo antagonists from ChemDiv library. A total of 21 structurally novel and diverse compounds were selected for experimental testing, and six of them exhibited significant inhibitory activity against the Hh pathway activation (IC₅₀ < 10 μM) in a GRE (Gli-responsive element) reporter gene assay. Specifically, the most potent compound (compound 20: 47 nM) showed comparable Hh signaling inhibition to vismodegib (46 nM). Compound 20 was further confirmed to be a potent Smo antagonist in a fluorescence based competitive binding assay. Optimization using substructure searching method led to the discovery of 12 analogues of compound 20 with decent Hh pathway inhibition activity, including four compounds with IC₅₀ lower than 1 μM. The important residues uncovered by binding free energy calculation (MM/GBSA) and binding free energy decomposition were highlighted and discussed. These findings suggest that the novel scaffold afforded by compound 20 can be used as a good starting point for further modification/optimization and the clarified interaction patterns may also guide us to find more potent Smo antagonists.