Related Experiment Video
Updated: Jul 14, 2026
07:11
ARL Spectral Fitting as an Application to Augment Spectral Data via Franck-Condon Lineshape Analysis and Color Analysis
Published on: August 19, 2021
[A study on the outlier mining system for LAMOST spectra].
1School of Computer Science and Technology, Taiyuan University of Science and Technology, Taiyuan 030024, China. jifuzh@sina.com
Guang Pu Xue Yu Guang Pu Fen Xi = Guang Pu
|June 9, 2007
Summary
This study introduces a new system for outlier mining in star spectra, aiding in the discovery of unknown celestial bodies. The system effectively identifies peculiar celestial spectra from large datasets.
Area of Science:
- Astronomy and Astrophysics
- Data Mining and Machine Learning
Context:
- Discovering unknown celestial bodies is a primary objective in space exploration.
- Analyzing large astronomical datasets, such as star spectra, is crucial for this discovery.
- Outlier mining offers a promising approach to identify anomalous or novel celestial objects within spectral data.
Purpose:
- To design and implement an effective outlier mining system for star spectra.
- To develop robust data preprocessing, clustering, and outlier detection algorithms tailored for spectral data.
- To enable the visualization of spectral outliers for easier identification and analysis.
Summary:
- A novel outlier mining system for star spectra was developed using VC++ and Oracle9i.
- Key components include median filter preprocessing, distance-based clustering, distance-support outlier mining, and PCA-based 3D visualization.
- Preliminary experiments on Sloan Digital Sky Survey (SDSS) data demonstrate the system's efficacy in identifying peculiar celestial spectra.
Impact:
- Provides a workable solution for outlier mining in astronomical spectral data.
- Offers a new method for discovering unknown and peculiar celestial bodies.
- Facilitates the exploration of vast astronomical datasets for novel discoveries.
Related Concept Videos
01:02Quantifying and Rejecting Outliers: The Grubbs Test
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This number is...
01:12What Are Outliers?
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
01:08Outliers and Influential Points
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the vertical...
01:00Detection of Gross Error: The Q Test
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
01:20Cluster Sampling Method
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
01:29Atomic Emission Spectroscopy: Lab
AES is a powerful analytical technique, especially effective when used with plasma sources, producing abundant spectra in characteristic emission lines. The Inductively Coupled Plasma (ICP), in particular, yields superior quantitative analytical data due to its high stability, low noise, low background, and minimal interferences under optimal experimental conditions. However, newer air-operated microwave sources are emerging as promising alternatives that could be more cost-effective than...