Migrating a research data warehouse to a public cloud: challenges and opportunities
Michael G Kahn1,2, Joyce Y Mui2, Michael J Ames3
1Section of Informatics and Data Science, Department of Pediatrics, University of Colorado School of Medicine, Aurora, CO, USA.
Journal of the American Medical Informatics Association : JAMIA
|December 17, 2021
Summary
Migrating research data warehouses (RDWs) to the cloud offers enhanced capabilities for data-driven discoveries. Despite challenges like legacy systems and security, cloud migration proves highly beneficial for research innovation and collaboration.
Area of Science:
- Health Informatics
- Computational Biology
- Data Science in Research
Background:
- Research data warehouses (RDWs) are crucial for data-driven discoveries, often linked to genomic pipelines.
- On-premises systems face limitations in computing and storage capacity for complex research needs.
- Cloud platforms offer scalability and flexibility essential for modern research environments.
Purpose of the Study:
- To describe the experience of migrating a multi-institutional RDW to a public cloud.
- To identify challenges and benefits associated with cloud migration for research data infrastructure.
Main Methods:
- Descriptive study utilizing internal/public presentations, analysis documents, and billing records.
- Findings were aggregated into topical categories to analyze migration issues.
- Focus on a multi-institutional research data warehouse migration to a public cloud environment.
Main Results:
- Eight categories of migration issues were identified, including legacy system constraints.
- Unanticipated challenges involved network, computing, and storage architectures.
- Complex security reviews, approvals, and limited cloud consulting expertise posed significant hurdles.
Conclusions:
- Cloud architectures unlock new research capabilities but present potential pitfalls.
- Rapid cloud evolution necessitates adaptable architectures and institutional policies.
- Effective governance, resource management, and cost oversight are critical for successful cloud adoption in research.
More Related Videos
Related Concept Videos
01:40Archival Research
16.6K
Some researchers gain access to large amounts of data without interacting with a single research participant. Instead, they use existing records to answer various research questions. This type of research approach is known as archival research. Archival research relies on looking at past records or data sets to look for interesting patterns or relationships. For example, a researcher might access the academic records of all individuals who enrolled in college within the past ten years and...
16.6K
01:29Issues And Trends In Healthcare Delivery System
5.9K
The issues and trends in healthcare delivery are constantly changing. The COVID-19 pandemic is one recent issue that wreaked havoc on healthcare systems, causing a shortage of healthcare workers, high demand for medicines and supplies, and increased medical expenditure due to a lack of insurance. Other issues include rising healthcare costs and care fragmentation.
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
5.9K
00:53Migration
8.1K
Migration is long-range, seasonal movement from one region or habitat to another. This common strategy, carried out by many different organisms around the world, is an adaptive response that typically corresponds to changes in an organism’s environment, like resource availability or climate. Migrations can involve huge groups of thousands of animals as well as single individuals traveling alone and can range from thousands of kilometers to just a few hundred meters.
8.1K
01:25Distribution Reliability and Automation
173
Distribution reliability in electrical power systems is critical for ensuring an uninterrupted power supply to consumers at minimal cost. According to IEEE Standard Terms, reliability is the probability that a device will function without failure over a specified time period or amount of usage. For electric power distribution, this translates to maintaining continuous power supply and addressing customer concerns over power outages. Several indices, as defined by IEEE Standard 1366-2012, are...
173
01:24Data Reporting and Recording
5.0K
Reporting and recording are crucial in data documentation. The timely, thorough, and accurate documentation of facts is essential when recording patient data. Failure to record findings during an assessment or interpretation of a problem will result in loss of information and make the patient document unreliable. The reader is left with general impressions if the information is not specific. A recording is documenting data of the individual's health information in a traceable, secure, and...
5.0K
01:30Health Information Technology and Healthcare Information System
989
Health Information Technology (HIT)
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
989