Jove
Visualize
联系我们
JoVE
x logofacebook logolinkedin logoyoutube logo
关于 JoVE
概览领导团队博客JoVE 帮助中心
作者
出版流程编辑委员会范围与政策同行评审常见问题投稿
图书馆员
用户评价订阅访问资源图书馆顾问委员会常见问题
研究
JoVE JournalMethods CollectionsJoVE Encyclopedia of Experiments存档
教育
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab Manual教师资源中心教师网站
使用条款与条件
隐私政策
政策

相关概念视频

Language Development01:22

Language Development

460
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
460
Improving Translational Accuracy02:07

Improving Translational Accuracy

2.7K
2.7K
Language and Cognition01:27

Language and Cognition

456
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
456

您也可能阅读

相关文章

通过共同作者、期刊和引用图与本文相关的文章。

排序
Same author

Scoping of Policy Impacts for Regulating E-cigarettes (SPIRE): findings from a data and decision analytic model mapping project.

NIHR open research·2026
Same author

Development and validation of a multi-agent AI pipeline for automated credibility assessment of tobacco misinformation: a proof-of-concept study.

Frontiers in artificial intelligence·2026
Same author

IQOS-marketing a tobacco product in the UK.

Tobacco control·2025
Same author

Developing and evaluating an educational intervention on conflicts of interest and corporate influence on science.

Health promotion international·2025
Same author

Impact of heated tobacco products on biomarkers of potential harm and adverse events: a systematic review and meta-analysis.

Tobacco control·2025
Same author

Effects of retail environment regulations on reducing tobacco retailers and operating hours: a case study in Egypt.

Tobacco control·2025

相关实验视频

Updated: Sep 17, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

692

在使用大型语言模型的烟草研究中,用于检索增强生成的可扩展评估框架.

Sherif Elmitwalli1, John Mehegan2, Sophie Braznell2

  • 1Tobacco Control Research Group, Department for Health, University of Bath, Bath, UK. se606@bath.ac.uk.

Scientific reports
|July 2, 2025
PubMed
概括

一个新的框架评估了烟草研究的检索增强生成 (RAG) 中的大型语言模型 (LLM). 混合8×7B的表现优于Llama 3.1 70B,这表明需要在公共卫生领域进行特定领域的LLM评估.

关键词:
人工智能评估AI评估域特定信息检索的获取专家验证验证是专家的验证.目标-问题-度量框架大型语言模型获取 - 增强生成

更多相关视频

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

592
Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application
05:56

Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application

Published on: April 14, 2023

2.6K

相关实验视频

Last Updated: Sep 17, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

692
Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

592
Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application
05:56

Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application

Published on: April 14, 2023

2.6K

科学领域:

  • 人工智能的人工智能
  • 公共卫生信息学 公共卫生信息学
  • 计算语言学 计算语言学

背景情况:

  • 专业知识领域需要对检索增强生成 (RAG) 系统进行强有力的评估.
  • 烟草研究领域缺乏用于评估大型语言模型 (LLM) 的标准化框架,这阻碍了用于公共卫生决策的准确信息检索.
  • 复杂的烟草行业文档需要特定领域的LLM评估.

研究的目的:

  • 开发和验证RAG系统的烟草领域特定评估框架.
  • 通过使用自动化指标和专家验证,在RAG配置中评估和比较不同LLM的性能.
  • 为LLM在专业知识领域的表现建立一个基准.

主要方法:

  • 在RAG系统中使用目标-问题-度量范式来评估LLMs (Mixtral 8×7B和Llama 3.1 70B).
  • 包含使用GPT-4o的自动评估和三名烟草研究专家的验证.
  • 采用了由20个精心策划的查询组成的域特定数据集,以衡量9个指标的性能,包括准确性,域特异性,完整性和清晰性.

主要成果:

  • 开发的框架成功地区分了LLM架构之间的性能.
  • 混合式8×7B在精度 (8.8/10对7.55/10) 和域特异性 (8.65/10对7.6/10) 中明显优于Llama 3.1 70B.
  • 超参数优化提高了Mixtral的完整性,证明了框架对模型改进的实用性.

结论:

  • 建立了一个强大的框架来评估烟草研究RAG系统中的LLMs,适用于其他专业领域.
  • 强调在公共卫生应用中对LLM进行领域特定评估的关键重要性,原因是性能存在显著差异.
  • 建议将框架扩展到更广泛的公司和额外的LLM进行全面评估.