可读性评估和大型语言模型生成的临床试验描述总结的可读性评估和比较临床试验.gov
Tzu-Chun Wu1, Hanniel Shih1, Anunita Nattam1
1University of Cincinnati, Cincinnati, OH, United States.
Studies in health technology and informatics
|August 8, 2025
概括
像ChatGPT这样的大型语言模型 (LLM) 可以提高临床试验.gov信息的可读性. 聊天GPT总结显示阅读水平较低,质量高于原始试验描述,有助于非专业人士的理解.
科学领域:
- 医疗信息学 医疗信息学
- 自然语言处理自然语言处理.
- 临床试验沟通临床试验沟通
背景情况:
- 临床试验.gov提供关键的试验信息.
- 试验描述的可读性往往很差,阻碍了公众的理解.
- 传统的可读性测量 (TRM) 用于评估文本的复杂性.
研究的目的:
- 为了评估临床试验.gov试验信息的可读性.
- 将原始试验描述的可读性与大语言模型 (LLM) 生成的摘要进行比较.
- 评估LLM生成的摘要的质量.
主要方法:
- 使用TRMs.gov对ClinicalTrials.gov描述的评估所需读取水平 (RRL).
- 使用ChatGPT和精心调整的BART-Large-CNN (FBLC) 生成的摘要.
- 通过两个独立审稿人的评分来评估摘要质量.
主要成果:
- 原始的ClinicalTrials.gov描述超过了推的可读性水平.
- 通过ChatGPT生成的摘要显示RRLs明显较低.
- 聊天GPT摘要从审查者那里获得了更高的质量评分.
结论:
- 聊天GPT展示了创建高可读性和高质量的试验摘要的潜力.
- 临床临床试验 (LLM) 可能提供一种可行的解决方案,以提高临床试验.gov的可读性.
- 需要进一步的研究来证实LLM在改善公众对临床试验数据的理解方面的实用性.
更多相关视频
相关概念视频
01:11Clinical Trials: Overview
3.4K
Clinical development focuses on how the drug will interact with the human body and encompasses four key phases of clinical trials, each serving a specific purpose in assessing the safety and effectiveness of new drugs. These phases overlap and build upon one another. Phase I involves a small group of healthy volunteers (typically 20-80 individuals) or, in cases where significant toxicity is expected, patients with the targeted disease, such as cancer or AIDS. The volunteers are tested for...
3.4K
01:16Clinical Trials
8.4K
Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and medical devices. Using statistics in clinical trials enables researchers to derive reasonable and accurate conclusions from the collected data, allowing them to make wise decisions in uncertain situations. In medical research, statistical methods are crucial for preventing errors and bias.
There are four phases in a clinical trial. A phase one...
There are four phases in a clinical trial. A phase one...
8.4K
02:07Improving Translational Accuracy
2.7K
2.7K
01:12Hazard Ratio
247
The hazard ratio (HR) is a widely used measure in clinical trials to compare the risk of events, such as death or disease recurrence, between two groups over time. It reflects the ratio of hazard rates—the instantaneous risk of the event occurring—between a treatment group and a control group. This measure provides valuable insights into the relative effectiveness of a treatment by assessing how the risk of an event differs between the two groups.
For example, in a clinical trial...
For example, in a clinical trial...
247
01:12Statistical Software for Data Analysis and Clinical Trials
789
Statistical software is pivotal in data analysis and clinical trials by providing tools to analyze data, draw conclusions, and make predictions. These software packages range from simple data management applications to complex analytical platforms, supporting various statistical tests, models, and simulation techniques. Their significance lies in their ability to handle vast amounts of data with precision and efficiency, enabling researchers to validate hypotheses, identify trends, and make...
789
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
174
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
174