Skip to content

No labels!

There aren’t any labels for this repository quite yet.

anti scraping technology
anti scraping technology
new layer of technology blockig previously available data
ATDIS
ATDIS
multiscraper based on implementing ATDIS (now probably defunct attempt at open data standard) NSW
blocked by authority
blocked by authority
If we're waiting on the authority to fix their site or change something
ci-anywhere
ci-anywhere
multi scraper based on ci-anywhere system used by councils
civica
civica
multi scraper based on Civica system used by councils
cloudflare
cloudflare
(403?) Specific technology often involved in blocking scrapers
compare data
compare data
to do: QA: compare latest DAs at authority w PA. Fixed or not?
council website bad
council website bad
Checked that information doesn't seem to be in an easy to use form any more on the council website
council website good
council website good
Checked that information is still available in an easy to use form on the council website
custom
custom
council using bespoke system
development-i
development-i
System originally used in Brisbane now shared with other councils
elementorg
elementorg
epathway
epathway
multi scraper based on epathway system https://www.infor.com/en-au/resources/epathway
granicus
granicus
platform for governments https://www.granicus.com.au
greenlight
greenlight
multi scraper based on greenlight system
horizon
horizon
multi scraper based on horizon / solorient
masterview
masterview
multi scraper based on masterview system
new scraper needed
new scraper needed
no da tracking site
no da tracking site
No information on the council website at all. Weird.
nsw planning portal
nsw planning portal
multiscraper based on NSW Statewide system
planbuild (tas)
planbuild (tas)
multi scraper based on planbuild TAS statewide system - early days -few councils adopted
probably fixed
probably fixed
Automatically added if this authority is getting data again on PlanningAlerts
quick fix
quick fix
maybe low hanging fruit here!
reported
reported
someone cared enough to report this broken
research
research
there's been a change, for example fewer DAs recently
ruby
ruby
this scraper written in RUBY
stuck - need help
stuck - need help
I don't know how to proceed. Need help (usually technical)