quanteda: An R package for the quantitative analysis of textual data

Kenneth Benoit; Kohei Watanabe; H. P. Wang; Paul Nulty; Adam Obeng; Stefan Müller; Akitaka Matsuo

doi:10.21105/joss.00774

Abstract

quanteda is an R package providing a comprehensive workflow and toolkit for natural language processing tasks such as corpus management, tokenization, analysis, and visualization.It has extensive functions for applying dictionary analysis, exploring texts using keywords-in-context, computing document and feature similarities, and discovering multi-word expressions through collocation scoring.Based entirely on sparse operations, it provides highly efficient methods for compiling document-feature matrices and for manipulating these or using them in further quantitative analysis.Using C++ and multithreading extensively, quanteda is also considerably faster and more efficient than other R and Python packages in processing large textual data.

Keywords

R packageComputer scienceNatural language processingInformation retrievalProgramming language

Affiliated Institutions

Related Publications

Stanza: A Python Natural Language Processing Toolkit for Many Human Languages

Peng Qi , Yuhao Zhang , Yuhui Zhang +2 more

We introduce Stanza, an open-source Python natural language processing toolkit supporting 66 human languages. Compared to existing widely used toolkits, Stanza features a langua...

2020 1321 citations

APE: Analyses of Phylogenetics and Evolution in R language

Emmanuel Paradis , Julien Claude , Korbinian Strimmer

Abstract Summary: Analysis of Phylogenetics and Evolution (APE) is a package written in the R language for use in molecular evolution and phylogenetics. APE provides both utilit...

2004 Bioinformatics 12200 citations

The Genome Analysis Toolkit: A MapReduce framework for analyzing next-generation DNA sequencing data

Aaron McKenna , Matthew G. Hanna , Eric Banks +8 more

Next-generation DNA sequencing (NGS) projects, such as the 1000 Genomes Project, are already revolutionizing our understanding of genetic variation among individuals. However, t...

2010 Genome Research 28298 citations

Recent Studies in Automatic Text Analysis and Document Retrieval

Gerard Salton

Many experts in mechanized text processing now agree that useful automatic language analysis procedures are largely unavailable and that the existing linguistic methodologies ge...

1973 Journal of the ACM 44 citations

Sentiment analyzer: extracting sentiments about a given topic using natural language processing techniques

Junbo Yi , Tetsuya Nasukawa , Răzvan Bunescu +1 more

We present sentiment analyzer (SA) that extracts sentiment (or opinion) about a subject from online text documents. Instead of classifying the sentiment of an entire document ab...

2004 719 citations

Publication Info

Year: 2018
Type: article
Volume: 3
Issue: 30
Pages: 774-774
Citations: 1221
Access: Closed

External Links

View on DOI.org

Social Impact

Altmetric

quanteda: An R package for the quantitative analysis of textual data

PlumX Metrics

Social media, news, blog, policy document mentions

Citation Metrics

1221

OpenAlex

Cite This

APA Style

                            
                                
                                    Kenneth Benoit, 
                                
                                    Kohei Watanabe, 
                                
                                    H. P. Wang
                                
                                et al.
                            
                            (2018). 
                            quanteda: An R package for the quantitative analysis of textual data. 
                            The Journal of Open Source Software
                            , 3
                            (30)
                            , 774-774.
                            https://doi.org/10.21105/joss.00774
                        

Identifiers

DOI: 10.21105/joss.00774