A scalable web crawler framework for Java.
Repository Index
132,241 visible repositories in the index
1–24 of 43 · Most stars
TranslatedA new-generation web crawler platform that defines crawler workflows graphically, so you can build a crawler without writing code.
Shattered Pixel Dungeon is an open-source traditional roguelike dungeon crawler with randomized levels and enemies, and hundreds of items to collect and use. It's based on the source code of Pixel Dungeon, by Watabou.
Apache KIE (Knowledge Is Everything) is the home of Drools, OptaPlanner, jBPM, and Kogito.
- rule-engine
- java
- dmn
- hacktoberfest
Enterprise-grade AI agent framework with multi-provider LLM management, secure knowledge bases and high-precision RAG, visual workflow orchestration, and multi-agent coordination.
TranslatedA knowledge base for vulnerability PoCs(Proof of Concept), with 1k+ vulnerabilities.
- poc
Open Source Web Crawler for Java
Application for Mind Mapping, Knowledge Management, Project Management. Develop, organize and communicate your ideas and knowledge in the most effective way.
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
- java
- webcrawling
- warc
- heritrix
Apache Nutch is an extensible and scalable web crawler
- java
- nutch
- web-crawler
- crawling
WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.
:octocat::fire: :star2::star::star::star: :star: 史上最全的BAT大厂Android面试题汇集,以及常用的Android开发的一些技能点,冷门知识点汇总,开发中遇到的坑汇总等干货。
Easy to use lightweight web crawler(易用的轻量化网络爬虫)
- gecco
- crawler
- jsoup
- fastjson
OpenSPG is a Knowledge Graph Engine developed by Ant Group in collaboration with OpenKG, based on the SPG (Semantic-enhanced Programmable Graph) framework. Core Capabilities: 1) domain model constrained knowledge modeling, 2) facts and logic fused representation, 3) natively support KAG...
- knowledge-graph
- knowledge-reasoning
- spg
- kag
Building Open-Ended Embodied Agents with Internet-Scale Knowledge
Internet search engine for text-oriented websites. Indexing the small, old and weird web.
- search-engine
- no-cloud
- small-web
- internet-search
NewPipe's core library for extracting data from streaming sites
一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.
Free database schema discovery and comprehension tool
- schemacrawler
- jdbc
- database-diagrams
- schema
Protege Desktop
- protege
- protege-desktop
- ontology
- owl
HummerRisk 是云原生安全平台,包括混合云安全治理和云原生安全检测。
- cloud-custodian
- cloud-native
- prowler
- security
Elasticsearch File System Crawler (FS Crawler)
- java
- elasticsearch
- crawler
- tika
AI 应用平台(聊天、绘画、知识库、工作流、 MCP服务市场、语音输入输出、长期记忆) | AI application platform (Chat,Draw,RAG,Workflow,MCP marketplace, ASR,TTS, Long-term memory etc)
- knowlege-base
- langchain4j
- rag
- graphrag
The missing, complete example of Domain-Driven Design enterprise application backed by Spring stack
- domain-driven-design
- domain-model
- ports-and-adapters
- domain-events