Technical challenges of providing record linkage services for research

Area of Science:

• Health Informatics
• Data Management
• Population Health Research

Background:

• Record linkage is crucial for longitudinal health research, often managed by specialised linkage units (SLUs).
• SLUs encounter technical challenges providing record linkage as a service, with limited focus in existing literature.
• Current record linkage systems often lack the full functionality required by SLUs.

Purpose of the Study:

• To identify and discuss essential functions for SLUs providing record linkage services.
• To present solutions for technical challenges faced by SLUs.
• To address the growing demand and complexity of linkage services.

Main Methods:

• Identifying required functions for SLUs in providing record linkage services.
• Discussing approaches to manage routine, ongoing linkage, and changing data.
• Exploring automated linkage processes for consistency and scalability.

Main Results:

• Maintaining link history and storing pairwise information addresses challenges with 'open' records and automated extractions.
• Solutions were implemented in Australia's National Linkage System (NLS).
• The presented solutions aim to improve the flexibility and scalability of record linkage services.

Conclusions:

• The increasing demand and complexity of linkage services challenge SLUs.
• SLUs require flexible and scalable solutions to meet diverse research needs.
• The proposed solutions can help mitigate difficulties faced by SLUs in providing efficient linkage services.