JoVE - Journal of Visualized Experiments
JoVE Visualize
Contact Us
这页已由机器翻译。其他页面可能仍然显示为英文。 View in English

可以在科学摘要中识别自己的文字吗?

  • 0Internal Medicine, University Institute for Primary Care, Geneva University Hospital, Geneva, CHE.
Cureus +

|

2025年八月27日

|

2025年八月27日

在PubMed上查看摘要

概括

此摘要是机器生成的。

聊天GPT-4.0努力区分人类和人工智能生成的科学摘要. 这项研究发现错误分类率很高,表明需要更好的工具来确保学术作者透明度.

科学领域

  • 科学文献中的人工智能
  • 学术出版的诚信

背景情况

  • 生成性AI的扩散在区分人工智能产生的科学内容方面带来了挑战.
  • 评估像ChatGPT-4.0这样的先进人工智能模型的自我识别人工智能生成文本的能力对于维持学术标准至关重要.

研究的目的

  • 评估ChatGPT-4.0在区分人类撰写和人工智能生成的科学摘要方面的准确性.
  • 确定ChatGPT-4.0是否可以在科学环境中可靠地识别自己的输出.

主要方法

  • 从具有影响力的内科杂志中选择了2000年的100篇原始研究摘要.
  • 从这些文章的全文中生成新的摘要.
  • ChatGPT-4.0对原始和人工智能生成的摘要进行了两次评估,在0-10级别上对作者概率进行了评分.

主要成果

  • 在两轮评估中都发现错误分类率很高 (49%和47.5%).
  • 没有任何摘要被赋予中性分数 (5),表明缺乏不确定性.
  • 统计分析显示得分分布的重叠和差异一致 (科恩卡帕=0.33,加权卡帕=0.24).

结论

  • 聊天GPT-4.0显示无法可靠地区分人类和人工智能生成的科学摘要.
  • 这些发现强调需要开发先进的外部工具来验证作者身份并确保学术出版的透明度.

关键词:

相关概念视频

Genetic Lingo 01:11

104.6K

Overview

An organism is diploid if it inherits two variants, or alleles, of each gene, one from each parent. These two alleles constitute the genotype for a given gene. The term genotype is also used to refer to an organism’s complete set of genes. A diploid organism with two identical alleles has a homozygous genotype, whereas two different alleles indicates a heterozygous genotype. Observable traits arising from genotypes are called phenotypes, which can also be influenced by...

Proofreading 01:43

54.9K

Overview

Synthesis of new DNA molecules starts when DNA polymerase links nucleotides together in a sequence that is complementary to the template DNA strand. DNA polymerase has a higher affinity for the correct base to ensure fidelity in DNA replication. The DNA polymerase furthermore proofreads during replication, using an exonuclease domain that cuts off incorrect nucleotides from the nascent DNA strand.

Errors during Replication Are Corrected by the DNA Polymerase Enzyme

Genomic DNA is...

GPCRs Regulate Adenylyl Cylase Activity 01:09

5.9K

Some GPCRs transmit signals through adenylyl cyclase (AC), a transmembrane enzyme. AC helps synthesize second messenger cyclic adenosine monophosphate (cAMP). AC catalyzes cyclization reaction and converts ATP to cAMP by releasing a pyrophosphate. The pyrophosphate is further hydrolyzed to phosphate by the enzyme pyrophosphatase, which drives cAMP synthesis to completion. However, cAMP is rapidly degraded to 5′ AMP by the enzymes phosphodiesterase (PDE), preventing overstimulation of...

Improving Translational Accuracy 02:07

11.9K

Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...

GTPases and their Regulation 02:14

2.4K
Scanning Electron Microscopy 01:07

4.4K

A scanning electron microscope (SEM) is used to study the surface features of a sample by using an electron beam that scans the sample surface in a two-dimensional manner. Typically, areas between ~1 centimeter to 5 micrometers in width can be imaged. SEM can be used to image bacteria, viruses, tissues as well as larger samples like insects. Conventional SEM gives a magnification ranging from 20X to 30,000X and spatial resolution of 50 to 100 nanometers.
Fundamental Principles
Accelerated...