Selection of Fitness Criteria for Learning Interpretable PDE Solutions via Symbolic Regression

Physics-Informed Symbolic Regression (PISR) offers a pathway to discover human-interpretable solutions to partial differential equations (PDEs). This work investigates three fitness metrics within a PISR framework: PDE fitness, Bayesian Information Criterion (BIC), and a fitness metric proportional to the probability of a model given the data. Through experiments with Laplace's equation, Burgers' equation, and a nonlinear wave equation, we demonstrate that incorporating information theoretic criteria like BIC can yield higher fidelity models while maintaining interpretability. Our results show that BIC-based PISR achieved the best performance, identifying an exact solution to Laplace's equation and finding solutions with $R^2$ -values of 0.998 for Burgers' equation and 0.957 for the nonlinear wave equation. The inclusion of the Bayes D-optimality criterion in estimating model probability strongly constrained solution complexity, limiting models to 3-4 parameters and reducing accuracy. These findings suggest that a two-stage approach-using simpler complexity metrics during initial solution discovery followed by a post-hoc identifiability analysis may be optimal for discovering interpretable and mathematically identifiable PDE solutions.