Efficient Learning of Sparse Representations with an Energy-Based Model
We describe a novel unsupervised method for learning sparse, overcomplete features. The model uses a linear encoder, and a linear decoder preceded by a sparsifying non-linearity...