Abstract

Computers understand very little of the meaning of human language. This profoundly limits our ability to give instructions to computers, the ability of computers to explain their actions to us, and the ability of computers to analyse and process text. Vector space models (VSMs) of semantics are beginning to address these limits. This paper surveys the use of VSMs for semantic processing of text. We organize the literature on VSMs according to the structure of the matrix in a VSM. There are currently three broad classes of VSMs, based on term-document, word-context, and pair-pattern matrices, yielding three classes of applications. We survey a broad range of applications in these three categories and we take a detailed look at a specific open source project in each category. Our goal in this survey is to show the breadth of applications of VSMs for semantics, to provide a new perspective on VSMs for those who are already familiar with the area, and to provide pointers into the literature for those who are less familiar with the field.

Keywords

Semantics (computer science)Meaning (existential)Computer scienceContext (archaeology)Space (punctuation)Perspective (graphical)Artificial intelligenceProgramming languagePsychology

Affiliated Institutions

Related Publications

Publication Info

Year
2010
Type
article
Volume
37
Pages
141-188
Citations
2827
Access
Closed

External Links

View on DOI.org

Social Impact

Altmetric
PlumX Metrics

Social media, news, blog, policy document mentions

Citation Metrics

2827
OpenAlex

Cite This

Peter D. Turney, Patrick Pantel (2010). From Frequency to Meaning: Vector Space Models of Semantics. Journal of Artificial Intelligence Research , 37 , 141-188. https://doi.org/10.1613/jair.2934

Identifiers

DOI
10.1613/jair.2934