- The basics of web scraping (slides)
- Scraping web data in table format and code
- Scraping web data in unstructured format and code
- Scraping data behind web forms and code
- Challenge 1: scraping the FDA website to analyze product recalls) with solution.
- What is an API? Example: scraping the New York Times API and code
- Collecting and analyzing social media data and code
- Challenge 2: what do presidential candidates tweet about? with solution.
For more on scraping and APIs, I recommend:
- Automated Data Collection with R, by Simon Munzert, Christian Rubba, Peter Meissner, and Dominic Nyhuis.