Skip to content

Latest commit

 

History

History
17 lines (13 loc) · 954 Bytes

README.md

File metadata and controls

17 lines (13 loc) · 954 Bytes

Purpose

This repository allows us to share data ADH-717 - Poultry and Red Meat Condemnations in Federally Registered Establishments - Criteria with the visualization team.

When the new monthly report is released, the CSV_downloader.pyscript is executed, and it downloads the new report and merges it into ADH-717 Poultry and Red Meat data.csv.

Updates

  • ADH-717 Poultry and Red Meat data.csv now contains all historical data (since 1999, instead of only a 3-year window).
  • Runs from Docker container, automated thanks to GitHub Actions (CRON job), instead of using Azure DataBricks.
  • Answers the security question to gain access to the new report.

Running the script locally

Building the container

docker build -t csvscraper .

Running the container

Modify the path to point to the docker run -v ./data:/usr/src/app/data -p 8081:8081 csvscraper