Modeling the European Neolithic expansion suggests predominant within-group mating and limited cultural transmission

The Neolithic Revolution initiated a pivotal change in human society, marking the shift from foraging to farming. Historically, the underlying mechanisms of agricultural expansion have been a topic of debate, centered around two primary models: cultural diffusion, involving the transfer of knowledge and practices, and demic diffusion, characterized by the migration and replacement of populations. More recently, ancient DNA analyses have revealed significant ancestry changes during Europe's Neolithic transition, suggesting a primarily demic expansion. Nonetheless, the presence of 10-15% hunter-gatherer ancestry in modern Europeans indicates cultural transmission and between-group mating were additional contributing factors. Here, we integrate mathematical models, agent-based simulations, and ancient DNA analysis to dissect and quantify the roles of cultural diffusion and between-group mating in farming's expansion. Our findings indicate limited cultural transmission and predominantly within-group mating. Additionally, we challenge the assumption that demic expansion always leads to ancestry turnover. These results offer insights into early agricultural society through the integration of ancient DNA with archaeological models.