When you are working with text mining, you might want to reduce the dimensionality of your problem. The word2vec algorithm, developed by Tomas Mikolov and others at Google, offers a nice approach. This page shows how to apply this algorithm within R.
Dmitriy Selivanov. GloVe Word Embeddings. Available in html format.