A next-generation crawling and spidering framework.
- crawler
- web-spider
- gocrawler
- spider-framework
47,133 repositories indexed
145–168 of 2,133 · Most stars
A next-generation crawling and spidering framework.
Internet-scale OpenID Certified™ OpenID Connect and OAuth2.1 provider that integrates with your user management through headless APIs. Solve OIDC/OAuth2 user cases over night. Consume as a service on Ory Network or self-host. Trusted by OpenAI and many others for scale and security. Written in Go.
GoDS (Go Data Structures) - Sets, Lists, Stacks, Maps, Trees, Queues, and much more
Turn any program that uses STDIN/STDOUT into a WebSocket server. Like inetd, but for WebSockets.
Secure environments for developers and their agents
IPFS implementation in Go: a daemon that stores and serves content-addressed data, with a CLI, HTTP Gateway, and RPC API
Translated🔥 Proxy is a high performance HTTP(S) proxies, SOCKS5 proxies,WEBSOCKET, TCP, UDP proxy server implemented by golang. Now, it supports chain-style proxies,nat forwarding in different lan,TCP/UDP port forwarding, SSH forwarding. It also supports communication encryption, smart HTTP and SOCKS5 proxies, blacklists and whitelists, speed limiting, traffic limiting, connection count limiting, cross-platform use, KCP, and an authentication API.
The personal information dashboard for your terminal
Workflow Engine for Kubernetes
Nomad is an easy-to-use, flexible, and performant workload orchestrator that can deploy a mix of microservice, batch, containerized, and non-containerized applications. Nomad is easy to operate and scale and has native Consul and Vault integrations.
The container platform tailored for Kubernetes multi-cloud, datacenter, and edge management ⎈ 🖥 ☁️
MCP for xiaohongshu.com
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database.
Pure Go implementation of the WebRTC API
MCP Toolbox for Databases is an open source MCP server for databases.
Hyperledger Fabric is an enterprise-grade permissioned distributed ledger framework for developing solutions and applications. Its modular and versatile design satisfies a broad range of industry use cases. It offers a unique approach to consensus that enables performance at scale while preserving privacy.
IM Chat OpenClaw
A fast TCP/UDP tunnel over HTTP
Automation engine to build, test and ship any codebase. Runs locally, in CI, or directly in the cloud
Cloudflare Tunnel client
A fast, cross-platform build tool inspired by Make, designed for modern workflows.
Bridge local AI coding agents (Claude Code, Cursor, Gemini CLI, Codex) to messaging platforms (Feishu/Lark, DingTalk, Slack, Telegram, Discord, LINE, WeChat Work). Chat with your AI dev assistant from anywhere — no public IP required for most platforms.
yq is a portable command-line YAML, JSON, XML, CSV, TOML, HCL and properties processor
BillionMail gives you open-source MailServer, NewsLetter, Email Marketing — fully self-hosted, dev-friendly, and free from monthly fees. Join the discord: https://discord.gg/asfXzBUhZr