Adiabatic projection: Bridging ab initio, density functional, semiempirical, and embedding approximations

Modern electronic structure approximations routinely employ reference systems described by approximate Hamiltonians. This work introduces the adiabatic projection formalism for building formally exact corrections to such reference systems. Starting from the real Hamiltonian of a many-electron system, one constructs a reference system Hamiltonian by projecting the kinetic and electron-electron interaction operators onto "interesting" states. The reference system is corrected by density functionals for the difference between the projected and unprojected kinetic and electron-electron energies. These density functionals are constructed from adiabatic connections between the reference and real systems. The Hohenberg-Kohn theorems imply the existence of exact functionals, which can ensure that the reference system's ground-state energy and density match the real system. Adiabatic projection further generalizes Kohn-Sham density functional theory (DFT) and the generalized adiabatic connection [W. Yang, J. Chem. Phys. 109, 10107 (1998)] and recovers these methods for certain choices of projection operators. Other choices of projection operators offer new opportunities, including formally exact and systematically improvable analogues to wavefunction-in-DFT embedding, DFT+U, and semiempirical theories. Numerical results are presented for two representative choices: a projected exchange-correlation correction to small-basis-set coupled cluster theory and a projected kinetic energy density functional correcting basis set errors in DFT. The latter offers performance for dimerization energies approaching the Boys-Bernardi counterpoise correction while also correcting intramolecular basis set superposition errors.