Skip to content
/ GoCU Public

A Go Crawler Utility (GoCU) which scrapes data on the web for items you're searching for!

License

Notifications You must be signed in to change notification settings

mmybo/GoCU

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

35 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Go Report Card

GoDoc

A Go Crawler Utility API (GoCU)

Simply make a post request using JSON, with the following format:

 {
     "Item": [word you are searching for],
     "URL": [web address you wish to search for it in]
 }

And GoCU will return all pages containing that word, and the links to them:

{
    "Item List": [
        "[Page Title]",
        "[URL Linking to Page]"
    ]
}

Docs page can be found here: https://mmybo.github.io/GoCU/

Deployed: https://gocu.herokuapp.com/

Also fun: an article about writing Go: https://medium.com/@jaesonbooker/learning-go-the-language-and-the-game-7373c47ae8e6

GoCU is open source, so you can clone it and make it even more powerful!

To start off, simply clone the repo, using 'git clone https://github.com/mmybo/GoCU.git' into your terminal.

Next install the dependencies, using the following commands: go get github.com/yhat/scrape go get golang.org/x/net/html go get golang.org/x/net/html/atom go get github.com/labstack/echo

And that's it! After that, just build and run! (go build, and go run main.go)

Run it locally, or deploy your own!

About

A Go Crawler Utility (GoCU) which scrapes data on the web for items you're searching for!

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages