The regression Tsetlin machine: a novel approach to interpretable nonlinear regression
K Darshana Abeyrathna1, Ole-Christoffer Granmo1, Xuan Zhang1
1Centre for Artificial Intelligence Research, University of Agder, Grimstad, Norway.
Summary
The regression Tsetlin machine (RTM) extends Tsetlin machines for continuous data, effectively tackling nonlinear regression problems. RTM demonstrates competitive or superior performance compared to current state-of-the-art regression methods.
Area of Science:
- Machine Learning
- Artificial Intelligence
- Computational Intelligence
Background:
- Tsetlin machines (TMs) have shown promise in pattern classification using bitwise operations.
- Existing TMs are primarily designed for discrete classification tasks.
- Nonlinear regression problems require specialized algorithms for continuous data handling.
Purpose of the Study:
- Introduce the regression Tsetlin machine (RTM) for nonlinear regression.
- Adapt Tsetlin machine principles to handle continuous input and output.
- Evaluate RTM performance against established regression techniques.
Main Methods:
- Convert continuous input data into a binary representation via thresholding.
- Utilize Tsetlin machine's propositional formula generation for regression.
- Aggregate the TM's output to produce a continuous prediction.
Main Results:
- RTM achieved competitive or superior performance on five benchmark datasets.
- Empirical comparisons validate RTM's effectiveness in nonlinear regression.
- The RTM approach offers a novel method for regression tasks.
Conclusions:
- The regression Tsetlin machine is a viable and effective tool for nonlinear regression.
- RTM offers an alternative to existing state-of-the-art regression methods.
- This work contributes to the advancement of energy-autonomous computing and intelligence.
Related Concept Videos
Regression Analysis
7.7K
Regression analysis is a statistical tool that describes a mathematical relationship between a dependent variable and one or more independent variables.
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
7.7K
Microsoft Excel: Regression Analysis
1.4K
Regression analysis in Microsoft Excel is a powerful statistical method for examining the relationship between a dependent variable and one or more independent variables. It's used extensively in fields such as economics, biology, and business to predict outcomes, understand relationships, and make data-driven decisions. The most common type is linear regression, which attempts to fit a straight line through the data points to model the relationship between variables.
To perform regression...
To perform regression...
1.4K
Regression Toward the Mean
6.8K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.8K
Multiple Regression
3.7K
Multiple regression assesses a linear relationship between one response or dependent variable and two or more independent variables. It has many practical applications.
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
3.7K
Residuals and Least-Squares Property
8.8K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
8.8K
Correlation and Regression
2.9K
In statistics, correlation describes the degree of association between two variables. In the subfield of linear regression, correlation is mathematically expressed by the correlation coefficient, which describes the strength and direction of the relationship between two variables. The coefficient is symbolically represented by 'r' and ranges from -1 to +1. A positive value indicates a positive correlation where the two variables move in the same direction. A negative value suggests a...
2.9K


