Can X-ray constrained Hartree-Fock wavefunctions retrieve electron correlation?

The X-ray constrained wavefunction (XC-WF) method proposed by Jayatilaka [Jayatilaka & Grimwood (2001) ▸, Acta Cryst. A57, 76-86] has attracted much attention because it represents a possible third way of theoretically studying the electronic structure of atoms and molecules, combining features of the more popular wavefunction- and DFT-based approaches. In its original formulation, the XC-WF technique extracts statistically plausible wavefunctions from experimental X-ray diffraction data of molecular crystals. A weight is used to constrain the pure Hartree-Fock solution to the observed X-ray structure factors. Despite the wavefunction being a single Slater determinant, it is generally assumed that its flexibility could guarantee the capture, better than any other experimental model, of electron correlation effects, absent in the Hartree-Fock Hamiltonian but present in the structure factors measured experimentally. However, although the approach has been known for long time, careful testing of this fundamental hypothesis is still missing. Since a formal demonstration is impossible, the validation can only be done heuristically and, to accomplish this task, X-ray constrained Hartree-Fock calculations have been performed using structure factor amplitudes computed at a very high correlation level (coupled cluster) for selected molecules in isolation, in order to avoid the perturbations due to intermolecular interactions. The results show that a single-determinant XC-WF is able to capture the electron correlation effects only partially. The largest amount of electron correlation is extracted when: (i) a large external weight is used (much larger than what has normally been used in XC-WF calculations using experimental data); and (ii) the high-order reflections, which carry less information on the electron correlation, are down-weighted (or even excluded), otherwise they would bias the fitting towards the unconstrained Hartree-Fock wavefunction.