Related Experiment Videos
Privacy-preserving outlier detection through random nonlinear data distortion
Kanishka Bhaduri1, Mark D Stefanski, Ashok N Srivastava
1Mission Critical Technologies Inc., NASA Ames Research Center, Moffett Field, CA 94035, USA. Kanishka.Bhaduri-1@nasa.gov
Summary
This study introduces nonlinear data distortion for privacy-preserving anomaly detection. It quantifies privacy and accuracy, allowing users to control privacy levels for sensitive datasets.
Area of Science:
- Data Mining
- Privacy-Preserving Techniques
- Anomaly Detection
Background:
- Data owners need to share sensitive data for analysis without compromising privacy.
- Existing methods primarily use linear data perturbations.
- A need exists for more robust privacy-preserving data mining techniques.
Purpose of the Study:
- To explore nonlinear data distortion for privacy-preserving anomaly detection.
- To develop bounds on accuracy and quantify privacy for nonlinear transformations.
- To enable user control over the privacy-utility trade-off.
Main Methods:
- Utilizing nonlinear random data transformations.
- Developing theoretical bounds on expected accuracy.
- Quantifying privacy using standard definitions.
- Applying transformations to linear and sigmoid models.
Main Results:
- Nonlinear distortion proves effective for privacy-preserving anomaly detection.
- The approach allows adjustable privacy levels through nonlinearity.
- Demonstrated effectiveness on real-life datasets.
- Analysis shows specific cases are distance preserving.
Conclusions:
- Nonlinear data distortion offers a flexible and effective method for privacy-preserving anomaly detection.
- The trade-off between privacy and data utility can be managed by adjusting nonlinearity.
- This approach enhances the security of sensitive data analysis.
Related Concept Videos
Outliers and Influential Points
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the vertical...
Quantifying and Rejecting Outliers: The Grubbs Test
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This number is...
Detection of Gross Error: The Q Test
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
What Are Outliers?
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
Random Error
Random or indeterminate errors originate from various uncontrollable variables, such as variations in environmental conditions, instrument imperfections, or the inherent variability of the phenomena being measured. Usually, these errors cannot be predicted, estimated, or characterized because their direction and magnitude often vary in magnitude and direction even during consecutive measurements. As a result, they are difficult to eliminate. However, the aggregate effect of these errors can be...
Wald-Wolfowitz Runs Test II
The Wald-Wolfowitz runs test, commonly referred to as the runs test, is a nonparametric test used to assess the randomness of ordered data. The test evaluates the number of runs, which are consecutive sequences of similar elements within the data. If the number of runs is significantly higher or lower than expected, the data is considered non-random, indicating a detectable pattern or structure.
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and 0s. In...
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and 0s. In...