Digital Humanities: Text Mining & Analysis
This guide supports Digital Humanities scholarship & practice at the University of Otago, by connecting people to the methods & tools, projects & other people transforming humanities scholarship in the digital realm
Getting Started
Voyant Tools 2.0Voyant Tools is a web-based reading and analysis environment for digital texts. You can paste or link to text and text corpora, and analyse and visualise the text in various ways. The following documentation give you an overview of the sorts of analysis and visualisation you can do http://voyant-tools.org/docs/#!/guide/tools
Easy tools to start with [list] | TAPoR 3 by Want to try out text analysis? Here are some easy, free, web-based tools to try.
Do More
TAPoR 3.0This gateway lists and reviews sophisticated to the tools used in text analysis, manipulation and visualisation. Hosted at the University of Alberta, it provides a place for Humanities researchers to find tools, contribute their experiences using them, and even share tools they have developed.
OverviewA powerful open-source tool to search, visualize, review and tag up to hundreds of thousands of documents in any format.
Text & corpus analysis
Stanford Named Entity Recognizer (NER)A Java-based Named Entity Recognizer (NER) which labels sequences of words in a text which are the names of things, such as person and company names, or gene and protein names.
TextometrieTextometry, born in France in the 80’s, has developed powerful techniques for the analysis of large body of texts. Following lexicometry and text statistical analysis, it offers tools and methods tested in multiple branches of the humanities and is statistically well founded.
AntConcA freeware corpus analysis toolkit for concordancing and text analysis.
Topic Modelling
Topic models are a type of statistical model used as a text-mining tool to discover the hidden semantic structures ("topics") occurring in a collection of documents. They are useful for analyzing large collections of unlabeled text.
MalletThe MALLET topic modeling toolkit (one among a number of MALLET tools) contains efficient, sampling-based implementations of Latent Dirichlet Allocation, Pachinko Allocation, and Hierarchical LDA. A useful tutorial is available - see the Learn More section.
Paper MachinesPaper Machines is a plugin for the Zotero bibliographic management software that makes cutting-edge topic-modeling analysis in Computer Science accessible to humanities researchers without requiring extensive computational resources or technical knowledge. It synthesizes several approaches to visualization within a highly accessible user interface.
dfr-browserDeveloped by a literary scholar, this enables users see the ways that a topic model attempts to classify words and documents through patterns of co-occurring words.
Visualising
BookwormBookworm is a simple and powerful way to visualize trends in repositories of digitized texts.
Advice on data mining, text mining, SAS Enterprise Miner and Text Miner: Damien Mather
Damien Mather | Senior Lecturer in MarketingDamien can provide advice on both text and data mining. He has experience using SAS Enterprise Miner and Text Miner, and supports the teaching of data and text mining to postgraduate students in the Departments of Marketing and Information Science.
Learn More
Text mining: an annotated bibliographyA useful overview of key writings on text mining/ analysis. A good place to start for those new to text analysis.
Hermeneutica: Computer-Assisted Interpretation in the Humanities [book] by Introduces text analysis using computer-assisted interpretive practices.
Getting Started with Topic Modelling and Mallet [online tutorial] | The Programming HistorianIn this tutorial, you will learn what topic modeling is and why you might want to employ it in your research. You will then learn how to install and work with the MALLET natural language processing toolkit to do so.
Visualising Literary Texts [blog post] by An introduction to analysing and visualising literary texts from a 2012 DH Summer Institute.
A brief introduction to distant reading
We want your feedback!
This guide continues to evolve, and we really welcome your feedback so we can continue to improve it. Please let us know if you find:
- Incorrect or irrelevant details, tools that don't work, dead links or otherwise unhelpful information
- Helpful details, tools, links or information that you think need to be on the guide, but aren't currently.
We'd also love to hear from you if you want to have your project featured on the guide, or would like to be profiled on the Connect&Collaborate@Otago page. Email Alexander Ritchie, with any comments or suggestions on how we can improve it.
Viva Digital Humanities!