Related Experiment Videos
Nearest-neighbor guided evaluation of data reliability and its applications
Tossapon Boongoen1, Qiang Shen
1Department of Computer Science, Aberystwyth University, SY233DB Aberystwyth, UK. tsb@aber.ac.uk
Summary
This study introduces a novel, efficient nearest-neighbor approach for data reliability in ordered weighted averaging (OWA) operators. This method enhances alias detection and feature selection, outperforming existing techniques.
Area of Science:
- Artificial Intelligence
- Data Science
- Machine Learning
Background:
- Ordered Weighted Averaging (OWA) operators increasingly incorporate data reliability.
- Existing data-oriented OWA operators like DOWA use centralized structures, neglecting local data consensus.
- Cluster-based OWA (Clus-DOWA) addresses this but has high computational costs.
Purpose of the Study:
- To propose a computationally efficient nearest-neighbor-based reliability measure for OWA operators.
- To generate OWA weights and decision-support explanations from this measure.
- To demonstrate the effectiveness of the proposed method in alias detection and unsupervised feature selection.
Main Methods:
- Developed a nearest-neighbor-based reliability assessment, avoiding costly clustering.
- Utilized a stress function to derive OWA weights and explanations.
- Applied the method to information aggregation for alias detection and unsupervised feature selection.
Main Results:
- The proposed nearest-neighbor reliability measure is more computationally efficient than clustering-based methods.
- The approach successfully generates OWA weights and decision-support explanations.
- Applied techniques demonstrated superior performance compared to conventional state-of-the-art methods in alias detection and feature selection.
Conclusions:
- The nearest-neighbor reliability measure offers an efficient alternative for OWA operators.
- This method effectively enhances data aggregation tasks like alias detection and unsupervised feature selection.
- The proposed techniques show significant potential for improving data analysis reliability and performance.
Related Concept Videos
Statistical Analysis: Overview
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
Detection of Gross Error: The Q Test
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
Data Validation
Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:
Key parameters for method validation include:
Data Validation
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing assessment guides are generally based on holistic models rather than medical...
Distribution Reliability and Automation
Distribution reliability in electrical power systems is critical for ensuring an uninterrupted power supply to consumers at minimal cost. According to IEEE Standard Terms, reliability is the probability that a device will function without failure over a specified time period or amount of usage. For electric power distribution, this translates to maintaining continuous power supply and addressing customer concerns over power outages. Several indices, as defined by IEEE Standard 1366-2012, are...
Reliability and Validity
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.