Abstract
The performance of an algorithm often largely depends on some hyper parameter which should be optimized before its usage. Since most conventional optimization methods suffer from some drawbacks, we developed an alternative way to find the best hyper parameter values. Contrary to the well known procedures, the new optimization algorithm is based on statistical methods since it uses a combination of Linear Mixed Effect Models and Response Surface Methodology techniques. In particular, the Method of Steepest Ascent which is well known for the case of an Ordinary Least Squares setting and a linear response surface has been generalized to be applicable for repeated measurements situations and for response surfaces of order o ?Ü 2.
Keywords
Mathematical optimizationResponse surface methodologySurface (topology)Computer scienceMathematicsLeast-squares function approximationAlgorithmApplied mathematicsStatistics
Related Publications
A Comparison of Least Squares and Latent Root Regression Estimators
Miilticollinesrity among the columns of regressor variables is known to cause severe distortion of the least squares estimates of the parameters in a multiple linear regression ...
ROBUST MODELING WITH ERRATIC DATA
An attractive alternative to least‐squares data modeling techniques is the use of absolute value error criteria. Unlike the least‐squares techniques the inclusion of some infini...
On enantiomorph-polarity estimation
The behaviour of Rogers's η parameter for enantiomorph-polarity estimation is examined theoretically and experimentally on simulated intensity data for seven well-assorted compo...
Topics in the Investigation of Linear Relations Fitted by the Method of Least Squares
Summary Various topics are reviewed: the effect of modern computers on statistical calculation; analysis by vector components rather than analysis merely of variance; “stepwise ...
Candelinc: A General Approach to Multidimensional Analysis of Many-Way Arrays with Linear Constraints on Parameters
Very general multilinear models, called CANDELINC, and a practical least-squares fitting procedure, also called CANDELINC, are described for data consisting of a many-way array....
Publication Info
- Year
- 2006
- Type
- article
- Citations
- 5
- Access
- Closed
External Links
Citation Metrics
5
OpenAlex
Cite This
Claus Weihs,
Karsten Luebke,
Irina Czogiel
(2006).
Response Surface Methodology for Optimizing Hyper Parameters.
Technical reports
.