A next-generation crawling and spidering framework.
- crawler
- web-spider
- gocrawler
- spider-framework
Repository Index
67,262 visible repositories in the index
1–9 of 9 · Most stars
Instant messaging platform. Backend in Go. Clients: Swift iOS, Java Android, JS webapp, scriptable command line; chatbots
- chat
- chat-application
- chatapp
- go
scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
- golang
- google-maps-scraping
- web-scraper
- web-scraping
Swiss-army tool for scraping and extracting data from online assets, made for hackers
- css
- curl
- gjson
- json
Extract structured data from web sites. Web sites scraping.
- golang
- golang-library
- extract-data
- chrome-fetcher
Extract web archive data using Wayback Machine and Common Crawl
- golang
- crawler
- commoncrawl
- wayback-machine
Text Generation using Markov Chains fed by 4chan APIs
- scrapper
- data-mining
- markov-chain
Seamlessly fetch paginated data from any source. Simple and high performance API scraping included!
- api-scraper
- indexer
- pagination
- paginator
automatic enumeration and maintenance of Suricata monitoring interfaces
- suricata
- interfaces
- automation
- network