Scraping the New York Times

As part of the Search and Surveillance Workshop Series, we will learn how to use Application Programming Interfaces (APIs) for web scraping. Our test case will be the New York Times API, which provides access to large amounts of article data with a single query. After retrieving data concerning topics that interest the participants, we will learn how to manage that data and perform basic text analysis tasks so that we can ask questions like, how has the language surrounding a given topic (say, climate change or marriage equality) changed over time? How does language differ across related but distinctive topics? What is the relationship between article frequency and search frequency concerning a topic over time?

Comments are closed.