TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
- webcrawler
- scrapy
- crawlab
- spiders-management
47,133 repositories indexed
1–18 of 18 · Most stars
TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
TranslatedWeekly Go Online Meetup via Bilibili|Go Night Reading|Share Go-related technical topics through live streaming on Bilibili, and every day everyone communicates and discusses programming topics in a timely way on WeChat/Telegram/Slack.
✨ A complete and self-contained solution for developers of any qualification to create a production-ready project with backend (Go), frontend (JavaScript, TypeScript) and deploy automation (Ansible, Docker) by running only one CLI command.
An archiving tool with an IM-style interface that prioritizes privacy and accessibility, integrated with various archival services including Internet Archive, archive.today, Ghostarchive, IPFS, Telegraph, and file systems.
A Go client library for the Twitter 1.1 API
Telegram Bot API library for Go
Extract structured data from web sites. Web sites scraping.
A Golang library and framework for the Discord API.
Android automation from code. Test your apps on real phones, script the tasks you repeat, run a shelf of phones, or let an AI agent use one, from Python, Node.js, the CLI, HTTP or Appium clients. No ADB, no USB cable, no root.
An elegant and concurrent library for the Telegram bot API in Go.
A declarative struct-tag-based HTML unmarshaling or scraping package for Go built on top of the goquery library
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
🤖 Go client library for accessing Telegram Bot API, with batteries for building complex bots included.
GoThanks automatically stars Go's official repository and your go.mod github dependencies, providing a simple way to say thanks to the maintainers of the modules you use and the contributors of Go itself.
Pagser is a simple, extensible, configurable parse and deserialize html page to struct based on goquery and struct tags for golang crawler
Search the web and primary sources, read full pages, and check every citation. MCP server for Claude, Cursor, Codex and more. Runs on your machine.
Client lib for Telegram bot api
A twitter pinbot using IPFS Cluster