April 2024 Crawl
Differences from February 2024 crawl:
- well-known data is no longer collected by the crawler. We use a python script instead, which is also included in this repo.
- longer database values are now stored as TEXT instead of varchar
- addition of OneTrustWPCCPAGoogleOptOut and OTGPPConsent cookies