Second-order MCSCF optimization revisited. I. Improved algorithms for fast and robust second-order CASSCF convergence

A new improved implementation of the second-order multiconfiguration self-consistent field optimization method of Werner and Knowles [J. Chem. Phys. 82, 5053 (1985)] is presented. It differs from the original method by more stable and efficient algorithms for minimizing the second-order energy approximation in the so-called microiterations. Conventionally, this proceeds by alternating optimizations of the orbitals and configuration (CI) coefficients and is linearly convergent. The most difficult part is the orbital optimization, which requires solving a system of nonlinear equations that are often strongly coupled. We present a much improved algorithm for solving this problem, using an iterative subspace method that includes part of the orbital Hessian explicitly, and discuss different strategies for performing the uncoupled optimization in a most efficient manner. Second, we present a new solver in which the orbital-CI coupling is treated explicitly. This leads to quadratic convergence of the microiterations but requires many additional evaluations of reduced (transition) density matrices. In difficult optimization problems with a strong coupling of the orbitals and CI coefficients, it leads to much improved convergence of both the macroiterations and the microiterations. Third, the orbital-CI coupling is treated approximately using a quasi-Newton approach with Broyden-Fletcher-Goldfarb-Shanno updates of the orbital Hessian. It is demonstrated that this converges almost as well as the explicitly coupled method but avoids the additional effort for computing many transition density matrices. The performance of the three methods is compared for a set of 21 aromatic molecules, an Fe(ii)-porphine transition metal complex, as well as for the [Cu₂O₂(NH₃)  ₆]²⁺, FeCl₃, Co₂(CO)₆C₂H₂, and Al₄O₂ complexes. In all cases, faster and more stable convergence than with the original implementation is achieved.