R tutorial: The TDM & DTM with text mining

Learn more about text mining with R: https://www.datacamp.com/courses/intro-to-text-mining-bag-of-words

With your cleaned corpus, you need to change the data structure for analysis. The foundation of bag of words text mining is either the term document matrix or document term matrix.

The term document matrix has each corpus word represented as a row with documents as columns. In this example you simply use the TermDocumentMatrix function on a corpus to create a TDM.

The document term matrix is the transposition of the TDM so each document is a row and each word is a column. Once again the aptly named DocumentTermMatrix function creates a matrix with documents as rows shown here. In its simplest form, the matrices contain word frequencies. However, other frequency measures do exist.

The qdap package relies on a word frequency matrix. This course doesn’t focus on the word frequency matrix, since it is less popular and can be made from a term document matrix.

#Rstats #R programming #data science #data analysis #learn R #R tutorial #data #big data #R for data science #R for data analysis #data science tutorial #data analysis tutorial #text mining #text mining with R