Create Validation Tests for Automated Content Analysis
Check whether the oolong needs to be updated
Clone an oolong object
Generate an oolong test
Deploy an oolong test
Export a deployable Shiny app from an oolong object into a directory
Print oolong gold standard object
Print and plot oolong summary
Obtain a locked oolong from a downloaded data file
Summarize oolong objects
Update an oolong object to the latest version
Intended to create standard human-in-the-loop validity tests for typical automated content analysis such as topic modeling and dictionary-based methods. This package offers a standard workflow with functions to prepare, administer and evaluate a human-in-the-loop validity test. This package provides functions for validating topic models using word intrusion, topic intrusion (Chang et al. 2009, <https://papers.nips.cc/paper/3700-reading-tea-leaves-how-humans-interpret-topic-models>) and word set intrusion (Ying et al. 2021) <doi:10.1017/pan.2021.33> tests. This package also provides functions for generating gold-standard data which are useful for validating dictionary-based methods. The default settings of all generated tests match those suggested in Chang et al. (2009) and Song et al. (2020) <doi:10.1080/10584609.2020.1723752>.
Useful links