为小型数据集优化词语嵌入:对来自乳腺癌患者的患者门户信息的案例研究
Qingyuan Song1, Congning Ni1, Jeremy L Warner2,3,4
1Vanderbilt University, Nashville, TN, 37240, USA.
Scientific reports
|July 12, 2024
概括
一个新的模型,PK-word2vec,通过使用先前知识,有效地处理患者门户信息. 这种自然语言处理的进步改善了小数据集中的词汇表示,有助于生物医学研究.
科学领域:
- 生物医学信息学 生物医学信息学
- 自然语言处理自然语言处理.
- 机器学习 机器学习
背景情况:
- 患者门户信息对生物医学研究有价值,但对标准自然语言处理模型具有挑战性.
- 传统的词嵌入模型,如word2vec,需要大量的数据集,这些数据集通常无法用于特定的临床环境.
- 针对特定条件的消息数量有限,阻碍了现有的文本分析技术的有效应用.
研究的目的:
- 介绍和评估PK-word2vec,这是一个新的word2vec适应,旨在用于小规模的文本体.
- 通过结合医疗和非医疗术语的先验知识来增强文字嵌入模型的培训.
- 改进患者门户消息的处理和语义理解.
主要方法:
- 开发了PK-word2vec,通过将预先训练的嵌入模型中的类似术语作为先前知识整合在一起.
- 将PK-word2vec应用于来自范德比尔特大学医学中心的乳腺癌患者门户信息数据集.
- 通过使用1000项任务对PK-word2vec与标准word2vec进行比较,并通过亚马逊机械土耳其工人和医学学生的评估来评估模型性能.
主要成果:
- 在90%以上的评估任务中,PK-word2vec显著优于标准的word2vec,在90%以上的评估任务中产生了更相关的单词相似性 (p=0.01).
- 该模型证明了从有限的患者门户信息库中学习词汇表示的有效性.
- 非专业人士和医学专家之间的评估者协议很高,这表明模型的性能强.
结论:
- PK-word2vec为患者门户消息的自然语言处理提供了显著的进步,特别是在数据稀缺的场景中.
- 该模型利用先前知识的能力可以在小数据集中增强语义表示.
- 这种方法可以从临床文本数据中获得更深入的见解,支持生物医学研究.
更多相关视频
相关概念视频
Patient-centered Care
2.0K
Patient-centered care involves delivering care beyond inpatient hospitalization. Reflective practice can enhance a patient-centered approach. Reflective practice is a process of reasoning that considers all aspects of the present situation, including practicalities, learning from personal practice, and consideration of patient needs. Patients appreciate care decisions made while considering their input. Involving the patient in their care provides the patient with a sense of contribution rather...
2.0K
Tumor Immunotherapy
509
Immunotherapy is a treatment that boosts or manipulates the immune system to fight diseases, including cancer. For instance, by stimulating an immune response through vaccinations against viruses that cause cancers, like hepatitis B virus and human papillomavirus, these diseases can be prevented. Nonetheless, some cancer cells can avoid the immune system due to their rapid mutation and division. The immune response to many cancers involves three phases: elimination, equilibrium, and escape.
509
Cancer Therapies
7.6K
Cancer therapies are various modes of treatment, such as surgery, radiation therapy, and chemotherapy that are administered to cancer patients.
However, cancer treatments can pose several challenges, as therapies used to kill cancer cells are generally also toxic to normal cells. Moreover, cancer cells mutate rapidly and can develop resistance to chemical agents or radiation therapy. Besides, all types of cancer cells may not respond to the same therapy. Some cancer cells respond to one...
However, cancer treatments can pose several challenges, as therapies used to kill cancer cells are generally also toxic to normal cells. Moreover, cancer cells mutate rapidly and can develop resistance to chemical agents or radiation therapy. Besides, all types of cancer cells may not respond to the same therapy. Some cancer cells respond to one...
7.6K
Cancer Vaccines
350
Cancer treatment vaccines are a rapidly evolving field that offers a promising approach to immunotherapy. Unlike traditional vaccines that prevent diseases, cancer treatment vaccines are designed to treat existing cancers by stimulating the immune system to recognize and attack cancer cells.
Cancer vaccines come in two categories: preventive (prophylactic) and treatment (active). Preventive vaccines, such as the Human Papillomavirus (HPV) vaccine, protect against viruses that cause certain...
Cancer vaccines come in two categories: preventive (prophylactic) and treatment (active). Preventive vaccines, such as the Human Papillomavirus (HPV) vaccine, protect against viruses that cause certain...
350
The Tumor Microenvironment
6.6K
Every normal cell or tissue is embedded in a complex local environment called stroma, consisting of different cell types, a basal membrane, and blood vessels. As normal cells mutate and develop into cancer cells, their local environment also changes to allow cancer progression. The tumor microenvironment (TME) consists of a complex cellular matrix of stromal cells and the developing tumor. The cross-talk between cancer cells and surrounding stromal cells is critical to disrupt normal tissue...
6.6K
Improving Translational Accuracy
2.6K
2.6K


