David Mackay

Free energy minimisation algorithmfor decoding and cryptanalysis

An algorithm is derived for inferring a binary vector s given noisy observations of As modulo 2, where A is a binary matrix. The binary vector is replaced by a vector of probabi...

Good error-correcting codes based on very sparse matrices

We study two families of error-correcting codes defined in terms of very sparse matrices. "MN" (MacKay-Neal (1995)) codes are recently invented, and "Gallager codes" were first ...

Turbo decoding as an instance of Pearl's "belief propagation" algorithm

We describe the close connection between the now celebrated iterative turbo decoding algorithm of Berrou et al. (1993) and an algorithm that has been well known in the artificia...

Good codes based on very sparse matrices

A Practical Bayesian Framework for Backpropagation Networks

A quantitative and practical Bayesian framework is described for learning of mappings in feedforward networks. The framework makes possible (1) objective comparisons between sol...