RAGFlow is an agent-native database: a Retrieval-Augmented Generation (RAG) engine that grew into context infrastructure.
Repository Index
132,241 visible repositories in the index
1–24 of 71 · Most stars
Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.
👾 Fast and simple video download library and CLI tool written in Go
Elegant Scraper and Crawler Framework for Golang
Weighs the soul of incoming HTTP requests to stop AI crawlers
- defense
- security
high-performance graph database for real-time use cases
- database
- distributed
- go
- knowledge-graph
A next-generation crawling and spidering framework.
- crawler
- web-spider
- gocrawler
- spider-framework
A Q&A platform software for teams at any scales. Whether it's a community forum, help center, or knowledge management platform, you can always count on Apache Answer.
- community
- golang
- react
- forum
TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
- webcrawler
- scrapy
- crawlab
- spiders-management
Quickly build text, voice and video agents. Fast, Go based Agent backend with SDKs for every language. Sensible defaults for search, knowledge, skills, telephony, sandboxes, memory and persistence. Sovereign AI. Take control of your AI.
Pholcus is a distributed high-concurrency crawler software written in pure golang
- spider
- crowler
⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org
Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application
A Mighty CLI for AWS
A self-hosted BitTorrent indexer, DHT crawler, content classifier and torrent search engine with web UI, GraphQL API and Servarr stack integration.
- bittorrent
- dht
- prowlarr
- radarr
TranslatedRecord CS knowlegement with XMind, version 2.0. Use XMind to record some designs of the Linux operating system, networking, C++, Golang, and databases
Translated53AI Hub is an open-source AI portal and knowledge base for managing enterprise knowledge, AI agents, prompts, and AI tools, seamlessly integrating with Coze, Dify, FastGPT, RAGFlow. An AI knowledge base and Agent portal
- coze
- dify
- fastgpt
- go
Automatically crawls proxy nodes on the public internet, de-duplicates and tests for usability and then provides a list of nodes
- crawler
- proxypool
Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
- endpoints
- endpoint-discovery
- bugbounty
- crawler
The cross-harness, self-improving memory layer for AI agents. Join our community: https://discord.com/invite/zdNChS2fBu
- security-tools
- agent-ai-cli
- agent-security
- mobile-device-management
Open-source, self-hosted customer support desk in a single binary. A lightweight alternative to Intercom, Zendesk, Chatwoot.
- customer-support
- helpdesk
- ticketing-system
- customer-support-automation
A simple command line notebook
A powerful browser crawler for web vulnerability scanners
- headless-chrome
- crawler
- chrome-devtools
- golang