Abstract
A versatile and practical method of searching a parameter space is presented. Theoretical and experimental results illustrate the usefulness of the method for such problems as the experimental optimization of the performance of a system with a very general multipeak performance function when the only available information is noise-distributed samples of the function. At present, its usefulness is restricted to optimization with respect to one system parameter. The observations are taken sequentially; but, as opposed to the gradient method, the observation may be located anywhere on the parameter interval. A sequence of estimates of the location of the curve maximum is generated. The location of the next observation may be interpreted as the location of the most likely competitor (with the current best estimate) for the location of the curve maximum. A Brownian motion stochastic process is selected as a model for the unknown function, and the observations are interpreted with respect to the model. The model gives the results a simple intuitive interpretation and allows the use of simple but efficient sampling procedures. The resulting process possesses some powerful convergence properties in the presence of noise; it is nonparametric and, despite its generality, is efficient in the use of observations. The approach seems quite promising as a solution to many of the problems of experimental system optimization.
Keywords
Affiliated Institutions
Related Publications
Empirical Functionals and Efficient Smoothing Parameter Selection
SUMMARY A striking feature of curve estimation is that the smoothing parameter ĥ 0, which minimizes the squared error of a kernel or smoothing spline estimator, is very difficul...
Spline Models for Observational Data.
This book serves well as an introduction into the more theoretical aspects of the use of spline models. It develops a theory and practice for the estimation of functions from no...
Approximate non-Gaussian filtering with linear state and observation relations
Two approaches to the non-Gaussian filtering problem are presented. The proposed filters retain the computationally attractive recursive structure of the Kalman filter and they ...
Ant system: optimization by a colony of cooperating agents
An analogy with the way ant colonies function has suggested the definition of a new computational paradigm, which we call ant system (AS). We propose it as a viable new approach...
On estimating noncausal nonminimum phase ARMA models of non-Gaussian processes
The authors address the problem of estimating the parameters of non-Gaussian ARMA (autoregressive moving-average) processes using only the cumulants of the noisy observation. Th...
Publication Info
- Year
- 1964
- Type
- article
- Volume
- 86
- Issue
- 1
- Pages
- 97-106
- Citations
- 1054
- Access
- Closed
External Links
Social Impact
Social media, news, blog, policy document mentions
Citation Metrics
Cite This
Identifiers
- DOI
- 10.1115/1.3653121