再現性を定量化するためのメトリックのスコーピングレビュー:多くの質問は多くのメトリックにつながります
Rachel Heyard1, Samuel Pawel2, Joris Frese3
1Center for Reproducible Science, University of Zurich Institute of Epidemiology Biostatistics and Prevention, Zurich, Switzerland.
Royal Society open science
|September 2, 2025
まとめ
この研究では 科学研究で使用されている 再現度メトリックを 検討しています 49のプロジェクトと97の論文から50の異なる指標を特定し,適切な措置を選択するためのガイドを提供しています.
科学分野:
- メタサイエンス
- 科学的再現性
- 研究の整合性
背景:
- 科学の進歩と整合性にとって 再現性は極めて重要です
- 複製の研究や再現性を定量化するプロジェクトは増えています
- 標準化されたメトリクスの欠如は,包括的な概要を必要とします.
研究 の 目的:
- 大規模な複製プロジェクトや方法論論文で使用されるメトリックを特定し,分類する.
- 適切な再現度メトリクスを選択するための包括的なリソースを提供する.
- 複製チームとメタ研究者がメトリックを研究目標に合わせるのを支援する.
主な方法:
- 大規模な複製プロジェクトと方法論論文のスコーピングレビューを実施しました.
- Scopus,MedLine,PsycINFO,EconLitで 関連する出版物を検索しました
- タイプ,入力,およびアプリケーションシナリオを含む再現性メトリックの抽出データ.
主要な成果:
- 49の大規模複製プロジェクトと97の方法論論文を特定した.
- 50の異なる再現性指標を抽出し特徴づけました
- 種類によって分類されたメトリック (公式,フレームワーク,グラフィック表現,研究,アルゴリズム).
結論:
- 様々な再現度メトリックが存在し,それぞれが特定の研究問題に対応しています.
- このレビューは,複製研究のためのメトリックの選択を導くために"ライブ"のインタラクティブテーブルを提供します.
- このリソースは,研究者がプロジェクト目標と一致するメトリックを選択するのに役立ちます.
さらに関連する動画
関連する概念動画
Statistical Analysis: Overview
7.3K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
7.3K
Variability: Analysis
189
Measures of variability are statistical metrics that reveal the dispersion pattern within a dataset. They are pivotal in biostatistics, providing insights into the heterogeneity within health and biological data. Variability signifies the degree to which data points diverge from one another, helping researchers understand the potential range of values and associated uncertainty within the data.
The range is a simple measure of variability, indicating the difference between the highest and...
The range is a simple measure of variability, indicating the difference between the highest and...
189
Data Validation
234
Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:
Key parameters for method validation include:
234
Random and Systematic Errors
12.5K
Scientists always try their best to record measurements with the utmost accuracy and precision. However, sometimes errors do occur. These errors can be random or systematic. Random errors are observed due to the inconsistency or fluctuation in the measurement process, or variations in the quantity itself that is being measured. Such errors fluctuate from being greater than or less than the true value in repeated measurements. Consider a scientist measuring the length of an earthworm using a...
12.5K
Uncertainty in Measurement: Accuracy and Precision
78.9K
Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value.
78.9K
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
174
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
174


