A next-generation crawling and spidering framework.
- crawler
- web-spider
- gocrawler
- spider-framework
47,133 repositories indexed
1–24 of 33 · Most stars
A next-generation crawling and spidering framework.
MCP for xiaohongshu.com
Bridge local AI coding agents (Claude Code, Cursor, Gemini CLI, Codex) to messaging platforms (Feishu/Lark, DingTalk, Slack, Telegram, Discord, LINE, WeChat Work). Chat with your AI dev assistant from anywhere — no public IP required for most platforms.
Instant messaging platform. Backend in Go. Clients: Swift iOS, Java Android, JS webapp, scriptable command line; chatbots
webhook is a lightweight incoming webhook server to run shell commands
An archiving tool with an IM-style interface that prioritizes privacy and accessibility, integrated with various archival services including Internet Archive, archive.today, Ghostarchive, IPFS, Telegraph, and file systems.
Temporal Go SDK
htmlquery is golang XPath package for HTML query.
Extract structured data from web sites. Web sites scraping.
An elegant and concurrent library for the Telegram bot API in Go.
The unix-way web crawler
Simple yet customizable bot framework written in Go.
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
Execution engine powering Flowbaker, a no code platform to build, connect, and automate workflows.
Extract web archive data using Wayback Machine and Common Crawl
Translated🎮 Update profile README / pinned gist to contain your Steam playtime leaderboard.
Translated📊 Update profile README / pinned gist to contain your weekly WakaTime stats. This is a Golang implementation, see the original version https://github.com/matchai/waka-box. Display your weekly WakaTime language usage statistics in your profile README / pinned gist.
Bots-as-a-Service for Slack
🤖 Go client library for accessing Telegram Bot API, with batteries for building complex bots included.
Disgo is the next generation of Discord API Consumption. Create a Discord Bot with Go using this Discord API Wrapper (SDK Client).
Pagser is a simple, extensible, configurable parse and deserialize html page to struct based on goquery and struct tags for golang crawler
A discord bot for reverse engineers and exploit developers.
Search the web and primary sources, read full pages, and check every citation. MCP server for Claude, Cursor, Codex and more. Runs on your machine.
Webpage summary extractor using Facebook Open Graph and arc90's readability