A neural probabilistic language model

BengioYoshua; DucharmeRéjean; VincentPascal; JanvinChristian

doi:10.5555/944919.944966

Abstract

A goal of statistical language modeling is to learn the joint probability function of sequences of words in a language. This is intrinsically difficult because of the curse of dimensionality: a wor...

Keywords

Curse of dimensionalityComputer scienceProbabilistic logicStatistical modelLanguage modelArtificial intelligenceNatural language processingFunction (biology)Machine learning

Related Publications

Scalable Techniques for Mining Causal Structures

Craig Silverstein , Sergey Brin , Rajeev Motwani +1 more

. Mining for association rules in market basket data has proved a fruitful area of research. Measures such as conditional probability (confidence) and correlation have been used...

1998 111 citations

Factored neural language models

Andrei T. Alexandrescu , Katrin Kirchhoff

We present a new type of neural probabilistic language model that learns a mapping from both words and explicit word features into a continuous space that is then used for word ...

2006 95 citations

A comparison of event models for naive bayes text classification

Andrew McCallum , Kamal Nigam

Recent work in text classification has used two different first-order probabilistic models for classification, both of which make the naive Bayes assumption. Some use a multi-va...

1998 3224 citations

Sequence to Sequence Learning with Neural Networks

Ilya Sutskever , Oriol Vinyals , Quoc V. Le

Deep Neural Networks (DNNs) are powerful models that have achieved excellent performance on difficult learning tasks. Although DNNs work well whenever large labeled training set...

2014 arXiv (Cornell University) 13295 citations

Recurrent Continuous Translation Models

Nal Kalchbrenner , Phil Blunsom

We introduce a class of probabilistic continuous translation models called Recurrent Continuous Translation Models that are purely based on continuous representations for words,...

2013 1330 citations

Publication Info

Year: 2003
Type: article
Citations: 2660
Access: Closed

External Links

View on DOI.org

Social Impact

Altmetric

A neural probabilistic language model

PlumX Metrics

Social media, news, blog, policy document mentions

Citation Metrics

2660

OpenAlex

Cite This

APA Style

                            
                                    BengioYoshua, 
                                
                                    DucharmeRéjean, 
                                
                                    VincentPascal
                                
                                et al.
                            
                            (2003). 
                            A neural probabilistic language model. 
                            Journal of Machine Learning Research
                            
                            .
                            https://doi.org/10.5555/944919.944966

Identifiers

DOI: 10.5555/944919.944966