Abstract
Abstract. The root-mean-squared error (RMSE) and mean absolute error (MAE) are widely used metrics for evaluating models. Yet, there remains enduring confusion over their use, such that a standard practice is to present both, leaving it to the reader to decide which is more relevant. In a recent reprise to the 200-year debate over their use, Willmott and Matsuura (2005) and Chai and Draxler (2014) give arguments for favoring one metric or the other. However, this comparison can present a false dichotomy. Neither metric is inherently better: RMSE is optimal for normal (Gaussian) errors, and MAE is optimal for Laplacian errors. When errors deviate from these distributions, other metrics are superior.
Keywords
Mean squared errorMean absolute errorMathematicsStatisticsMetric (unit)ConfusionGaussianMean squarePsychology
Affiliated Institutions
Related Publications
The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression analysis evaluation
Regression analysis makes up a large part of supervised machine learning, and consists of the prediction of a continuous independent target from a set of other predictor variabl...
Spline Smoothing in Regression Models and Asymptotic Efficiency in $L_2$
For nonparametric regression estimation on a bounded interval, optimal rates of decrease for integrated mean square error are known but not the best possible constants. A sharp ...
Nonparametric Bayesian Regression
It is desired to estimate a real valued function F on the unit square having observed F with error at N points in the square. F is assumed to be drawn from a particular Gaussian...
Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification.
This study evaluated the sensitivity of maximum likelihood (ML)-, generalized least squares (GLS)-, and asymptotic distribution-free (ADF)-based fit indices to model misspecific...
Summarizing the predictive power of a generalized linear model
This paper studies summary measures of the predictive power of a generalized linear model, paying special attention to a generalization of the multiple correlation coefficient f...
Publication Info
- Year
- 2022
- Type
- article
- Volume
- 15
- Issue
- 14
- Pages
- 5481-5487
- Citations
- 1308
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
1308
OpenAlex
Cite This
Timothy Hodson
(2022).
Root-mean-square error (RMSE) or mean absolute error (MAE): when to use them or not.
Geoscientific model development
, 15
(14)
, 5481-5487.
https://doi.org/10.5194/gmd-15-5481-2022
Identifiers
- DOI
- 10.5194/gmd-15-5481-2022