Abstract

The problem of spectral estimation on the basis of observations from a finite stretch of a stationary time series is considered, in connection with knowledge of a prior estimate of the spectral density. A reasonable posterior spectral density estimate would be the density that is closest to the prior according to some measure of divergence, while at the same time being compatible with the data. The cross entropy has often been proposed to serve as such a measure of divergence. A correction of the original minimum-cross-entropy spectral analysis (MCESA) method of J.E. Shore (see IEEE Trans. Acoust. Speech Signal Process, vol.29, p.230-7, 1981) to traditional prewhitening techniques and to autoregressive moving average (ARMA) models is pointed out and a fast approximate solution of the minimum cross entropy problem is proposed. The solution is in a standard multiplicative form, that is, the posterior is equal to the prior multiplied by a correction factor.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

Keywords

MathematicsMaximum entropy spectral estimationEntropy (arrow of time)Autoregressive modelKullback–Leibler divergenceAutoregressive–moving-average modelSpectral density estimationSpectral densityApplied mathematicsDivergence (linguistics)Multiplicative functionPrinciple of maximum entropyStatisticsMathematical analysisFourier transformPhysics

Affiliated Institutions

Related Publications

Publication Info

Year
1993
Type
article
Volume
41
Issue
2
Pages
781-787
Citations
5
Access
Closed

External Links

Social Impact

Social media, news, blog, policy document mentions

Citation Metrics

5
OpenAlex

Cite This

Dimitris N. Politis (1993). ARMA models, prewhitening, and minimum cross entropy. IEEE Transactions on Signal Processing , 41 (2) , 781-787. https://doi.org/10.1109/78.193217

Identifiers

DOI
10.1109/78.193217