在机器学习代码中检测数据泄漏:转移学习,主动学习或低射门提示?
Nouf Alturayeif1,2, Jameleddine Hassine1,3
1Information and Computer Science Department, King Fahd University of Petroleum and Minerals, Dhahran, Saudi Arabia.
PeerJ. Computer science
|March 26, 2025
概括
本研究介绍了基于机器学习 (ML) 的方法来检测ML代码中的代码级数据泄露. 积极学习被证明是最有效的,显著减少了对注释数据的需求,同时提高了检测准确性.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 软件工程 软件工程 软件工程
背景情况:
- 机器学习 (ML) 代码质量对于可靠的模型性能至关重要,数据泄露是一个重大问题.
- 数据泄露,测试集信息影响培训,膨胀指标并损害概括.
- 现有的代码级数据泄露检测方法往往是手动的或缺乏先进的自动化.
研究的目的:
- 探索和提出基于ML的方法来检测代码级数据泄露,特别是有限的注释数据集.
- 为了有效地解决在大型和复杂的ML代码库中识别质量问题的挑战.
- 开发自动化方法来处理与泄漏检测相关的不平衡代码数据.
主要方法:
- 研究了三种基于机器学习的方法:转移学习,主动学习和低射门提示.
- 开发了一种自动化方法来管理特定于代码数据的数据不平衡问题.
- 评估了这些方法在检测代码级数据泄露方面的有效性.
主要成果:
- 积极学习表现出卓越的表现,F-2得分为0.72.
- 积极学习将所需的注释样本数量从1523个减少到698个.
- 提出的基于ML的方法有效地解决了有限的数据可用性所带来的挑战.
结论:
- 基于ML的方法,特别是主动学习,对于检测ML代码中的代码级数据泄露是有效的.
- 这些方法显著提高了效率,减少了大量手动注释的需要.
- 自动检测数据泄露可以提高ML代码质量和模型可靠性.
更多相关视频
08:05Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
Published on: June 30, 2020
7.4K
06:37Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
Published on: December 15, 2023
2.5K
相关概念视频
Types of Errors: Detection and Minimization
1.4K
Error is the deviation of the obtained result from the true, expected value or the estimated central value. Errors are expressed in absolute or relative terms.
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
1.4K
Improving Translational Accuracy
8.5K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
8.5K
Observational Learning
111
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
111
Data Validation
4.8K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing assessment guides are generally based on holistic models rather than medical...
4.8K
Censoring Survival Data
54
Survival analysis is a statistical method used to analyze time-to-event data, often employed in fields such as medicine, engineering, and social sciences. One of the key challenges in survival analysis is dealing with incomplete data, a phenomenon known as "censoring." Censoring occurs when the event of interest (such as death, relapse, or system failure) has not occurred for some individuals by the end of the study period or is otherwise unobservable, and it might have many different...
54
Detection of Gross Error: The Q Test
5.0K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
5.0K
