Harnessing Pattern Recognition Techniques for Data Quality Detection

While most treatises on data quality emphasise frameworks and best practice, they often overlook a critical factor: the work is seen as tedious and dull, something that needs to be done quickly before getting onto the really exciting steps of producing results. But it doesn't have to be boring! Just as detective work is glamorised in books and police dramas, data quality detection can also be fun. With new AI-powered tools at our disposal, we can transform quality detection into a rewarding investigation. In this talk, I will share insights from my experiences in identifying data quality issues in health datasets, illustrating how the role of a data quality detective can be both empowering and rewarding.