Proxy [Finder | Checker | Server]. HTTP(S) & SOCKS :performing_arts:
Repository Index
132,241 visible repositories in the index
217–240 of 1,135 · Most stars
DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
- crawler
- dotnetcore
- cross-platform
- csharp
The open-source context layer for AI agents and enterprise AI search. Permission-aware search and cited answers across 30+ sources, including Slack, Drive, Jira, GitHub and Microsoft 365, for people and agents through MCP, SDKs and built-in agents. Self-hosted or Cloud.
[NeurIPS'24] HippoRAG is a novel RAG framework inspired by human long-term memory that enables LLMs to continuously integrate knowledge across external documents. RAG + Knowledge Graphs + Personalized PageRank.
Task management for the Obsidian knowledge base.
- obsidian-plugin
- obsidian-tasks
- task-manager
- task-management
An Open-Source Package for Knowledge Embedding (KE)
- knowledge-embedding
Automatically crawls proxy nodes on the public internet, de-duplicates and tests for usability and then provides a list of nodes
- crawler
- proxypool
Eases DOM navigation for HTML and XML documents
Intelligent proxy pool for Humans™ to extract content from the internet and build your own Large Language Models in this new AI era
- crawler
- python3
- scylla
- proxy-pool
The successor to Hyperion aka Hyperion Next Generation
- hyperion
- ambilight
- hue
- adalight
LeanCTX is the Context Gateway for AI Systems. Select task-relevant context, apply supported controls, connect local knowledge and inspect recorded evidence. Open-source Engine: CLI, MCP, hooks and supported proxy paths.
Built by a PhD whose memory was failing, whose diet was a mess, and whose anxiety had its own agenda. Most second brain tools ignore the fact that your brain doesn't work in isolation: your body and your mental health are part of the system too. This crew handles all three: knowledge, nutrition, and mental wellness.
Headless Chrome .NET API
- puppeteer
- chrome
- chromium
- automation
📚 The open-source, offline-first Notion, Obsidian & Confluence alternative. Advanced Markdown, multi-tenant teams, OIDC/SSO, and local S3 backups. Deploy in one command.
Awesome Knowledge Distillation
- knowledge-distillation
- knowledge-transfer
- teacher-student
- co-training
Easiest and laziest way for building multi-agent LLMs applications.
[ICML'26] SimpleMem: Efficient Lifelong Memory for LLM Agents — Text & Multimodal
All in one tool for Information Gathering, Vulnerability Scanning and Crawling. A must have tool for all penetration testers
- scanner
- crawler
- information-gathering
- admin-scanner
Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
- endpoints
- endpoint-discovery
- bugbounty
- crawler
新闻网页正文通用抽取器 Beta 版.
- python3
- webcrawler
- webspider
PENTEST-WIKI is a free online security knowledge library for pentesters / researchers. If you have a good idea, please share it with others.
Framework for AI agents to build and maintain a digital brain through Obsidian wiki | Memory System for Agents
- agent-skills
- knowledge-base
- llm-tools
- obsidian
A list of practical knowledge-building projects.
- programming
- projects
- python
- web-scraper