Related Experiment Video
Updated: Jul 18, 2025

Cell-Free DNA Integrity Analysis in Urine Samples
Published on: January 5, 2017
aws-s3-integrity-check: an open-source bash tool to verify the integrity of a dataset stored on Amazon S3
Sonia García-Ruiz1,2, Regina Hertfelder Reynolds1,2, Melissa Grant-Peters1,2
1Department of Genetics and Genomic Medicine Research & Teaching, UCL GOS Institute of Child Health, London, UK.
Abstract:
Amazon Simple Storage Service (Amazon S3) is a widely used platform for storing large biomedical datasets. Unintended data alterations can occur during data writing and transmission, altering the original content and generating unexpected results. However, no open-source and easy-to-use tool exists to verify end-to-end data integrity. Here, we present aws-s3-integrity-check, a user-friendly, lightweight, and reliable bash tool to verify the integrity of a dataset stored in an Amazon S3 bucket. Using this tool, we only needed ∼114 min to verify the integrity of 1,045 records ranging between 5 bytes and 10 gigabytes and occupying ∼935 gigabytes of the Amazon S3 cloud. Our aws-s3-integrity-check tool also provides file-by-file on-screen and log-file-based information about the status of each integrity check. To our knowledge, this tool is the only open-source one that allows verifying the integrity of a dataset uploaded to the Amazon S3 Storage quickly, reliably, and efficiently. The tool is freely available for download and use at https://github.com/SoniaRuiz/aws-s3-integrity-check and https://hub.docker.com/r/soniaruiz/aws-s3-integrity-check.
More Related Videos
05:51Assessing the Accuracy of Fitness Smartwatch Data for Cardiovascular and Physical Activity Monitoring: A Validation Study in Digital Health
Published on: February 21, 2025
12:50Lesion Explorer: A Video-guided, Standardized Protocol for Accurate and Reliable MRI-derived Volumetrics in Alzheimer's Disease and Normal Elderly
Published on: April 14, 2014
Related Concept Videos
Data Validation
Key parameters for method validation include:
Quality Assurance
Reliability and Validity
Contaminants and Errors
Another key consideration is determining the appropriate number of samples required to...
The Spindle Assembly Checkpoint
Many proteins function together to control the spindle assembly checkpoint. Mutations affecting these proteins may allow cells to proceed into anaphase prematurely, resulting in the...
Accuracy, limits, and approximation
Accuracy is defined as the closeness of the measured value to the true or actual value. In engineering mechanics, repeated measurements are taken during theoretical or experimental analyses to ensure that the result is precise and accurate.
The accuracy of any solution is based on the...