README_old.md

In kbenoit/LIWCalike: Text analysis similar to the Linguistic Inquiry and Word Count (LIWC)

LIWCalike: an R implementation of the Linguistic Inquiry and Word Count

Built on the quanteda package for text analysis, LIWCalikes provides a simple interface to the analysis of text by counting words and other textual features, including the application of a dictionary to produce a tabular report of percentages. This provides similar functionality to the LIWC stand-alone software.

The user must supply a dictionary, which can include one of the custom LIWC dictionaries if these have been purchased from http://liwc.wpengine.com, or any other dictionary supplied by the user. The dictionary() constructor of the quanteda package, on which LIWCalike is built, can read both LIWC and Wordstat-formatted dictionary files, or you can use it to create a dictionary from an R list object (a named list of character vectors, where each character vector is a set of dictionary match patterns and its associated name is the dictionary key).

Differences from the LIWC standalone software

This package is designed for R users and those wishing to build functionality by extending the quanteda package for text analysis. If you prefer to have a complete, stand-alone user interface, then you should purchase and use the LIWC standalone software. This has several advantages:

• LIWC allows direct importing of files, including binary (Word, pdf, etc) formats. To use LIWCalike, you will need to import these into the quanteda package first. LIWCalike also works fine with simple character vectors, if you prefer to use standard R methods to create your input object (e.g. readLines(), read.csv(), etc.)

• LIWC provides direct outputs in the form of csv, Excel files, etc. By contrast, LIWCalike returns a data.frame, which you have to export yourself (e.g. using write.csv().)

• LIWC provides easy segmentation, through a GUI. By contrast, with LIWCalike you will have to segment the texts yourself. (quanteda provides easy ways to do this using segment() and changeunits().)

• LIWC color codes the dictionary value matches in your texts and displays these in a nice graphical window.

• LIWC provides four composite measures that are not included in LIWCalike: “Analytic”, “Clout”, “Authentic”, and “Tone”. These are based on proprietary algorithms, as described and refernced in Pennebaker, J.W., Boyd, R.L., Jordan, K., & Blackburn, K. (2015). The development and psychometric properties of LIWC2015. Austin, TX: University of Texas at Austin. D OI: 10.15781/T29G6Z.

Using dictionaries with LIWCalike

No dictionaries are supplied with LIWCalike, it is up to you to supply these. With the quanteda functions for creating or importing dictionaries, however, this is quite easy.

With the LIWC 2007, external dictionaries were distributed with the software that could be used in the format read by Provalis Research’s Wordstat. Because I purchases a license for this product, I have that file and can use it with LIWCalike.

Using it is quite straightforward:

library("LIWCalike")
library("quanteda")
#> Package version: 1.2.1
#> Parallel computing: 4 of 8 threads used.
#> See https://quanteda.io for tutorials and examples.
#> 
#> Attaching package: 'quanteda'
#> The following object is masked from 'package:utils':
#> 
#>     View

# read in the dictionary
liwc2007dict <- dictionary(file = "~/Dropbox/QUANTESS/dictionaries/LIWC/LIWC2007.cat", 
                           format = "wordstat")
tail(liwc2007dict, 1)
#> Dictionary object with 1 primary key entry and 2 nested levels.
#> - [SPOKEN CATEGORIES]:
#>   - [ASSENT]:
#>     - absolutely, agree, ah, alright*, aok, aw, awesome, cool, duh, ha, hah, haha*, heh*, hm*, huh, lol, mm*, oh, ok, okay, okey*, rofl, uhhu*, uhuh, yah, yay, yea, yeah, yep*, yes, yup
#>   - [NON-FLUENCIES]:
#>     - er, hm*, sigh, uh, um, umm*, well, zz*
#>   - [FILLERS]:
#>     - blah, idon'tknow, idontknow, imean, ohwell, oranything*, orsomething*, orwhatever*, rr*, yakn*, ykn*, youknow*

# our test data
data_char_testphrases
#>  [1] "Test sentence for LIWCalike.  Second sentence."                   
#>  [2] "Each row is a document."                                          
#>  [3] "Comma, period."                                                   
#>  [4] "The red-shirted lawyer gave her ex-boyfriend $300 out of pity :(."
#>  [5] "LOL :)."                                                          
#>  [6] "(Parentheses) for $100."                                          
#>  [7] "Say \"what\" again!!"                                             
#>  [8] "Why are we here?"                                                 
#>  [9] "Other punctation: ^; %, &."                                       
#> [10] "Sentence one.  Sentence two! :-)"

# call LIWCalike
output <- liwcalike(data_char_testphrases, liwc2007dict)
#> Warning: 'nfeature' is deprecated.
#> Use 'nfeat' instead.
#> See help("Deprecated")

#> Warning: 'nfeature' is deprecated.
#> Use 'nfeat' instead.
#> See help("Deprecated")

# view some results
output[, c(1:7, ncol(output)-2)]
#>    docname Segment WC WPS.document WPS.meanSentenceLength Sixltr   Dic
#> 1    text1       1  8        text1                      3  37.50 37.50
#> 2    text2       2  6        text2                      5  16.67 50.00
#> 3    text3       3  4        text3                      2   0.00 25.00
#> 4    text4       4 18        text4                     12  11.11 61.11
#> 5    text5       5  4        text5                      1   0.00 25.00
#> 6    text6       6  7        text6                      3  14.29 28.57
#> 7    text7       7  7        text7                      3   0.00 42.86
#> 8    text8       8  5        text8                      4   0.00 80.00
#> 9    text9       9  9        text9                      2  11.11 11.11
#> 10  text10      10  9       text10                      2  22.22 22.22
#>    LINGUISTIC PROCESSES.FUNCTION WORDS Apostro
#> 1                                25.00       0
#> 2                                50.00       0
#> 3                                 0.00       0
#> 4                                22.22       0
#> 5                                 0.00       0
#> 6                                14.29       0
#> 7                                28.57       0
#> 8                                60.00       0
#> 9                                11.11       0
#> 10                               22.22       0

How to Install

LIWCalike is currently only available on GitHub, not on CRAN. The best method of installing it is through the devtools package:

devtools::install_github("kbenoit/LIWCalike")

This will also automatically install the quanteda package on which LIWCalike is built.

Comments, feedback, and code of conduct

I welcome your comments and feedback. Please file issues on the issues page, and/or send me comments at [e-mail].

Please note that this project is released with a Contributor Code of Conduct. By participating in this project you agree to abide by its terms.

kbenoit/LIWCalike documentation built on May 20, 2019, 7:54 a.m.