A scalable web crawler framework for Java.
Repository Index
76,855 visible repositories in the index
1–24 of 32 · Most stars
jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.
💼【AI找工作助手】全平台自动投简历脚本：(boss、前程无忧、猎聘、智联招聘)
- ai
- getjob
- job-application
- job-search
Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.
Java library to create bots using Telegram Bots API
- telegram-bot
- telegram-bots-api
- webhook
- java-library
AdSkip — an Android assistant for automatically skipping app launch ads
- android
- splash
- screen
- startup
Downloads albums from the web in bulk for archive purposes
- ripme
- java
- album
- downloader
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
- java
- webcrawling
- warc
- heritrix
Apache Nutch is an extensible and scalable web crawler
- java
- nutch
- web-crawler
- crawling
WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.
Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a Kafka cluster. It provides great value to Kafka users by simplifying the operation of Kafka clusters.
- kafka
- cluster-management
- self-healing
Perplexity Scraper Track brand mentions, analyze rankings, and gain competitor intelligence from Perplexity. Get started in minutes.
- ai-scraper
- llm-api
- llm-scraper
- llm-scraping
NewPipe's core library for extracting data from streaming sites
一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.
Telegram Bot API for Java
- telegram
- telegram-bot
- telegram-api
- bot
Discord4J is a fast, powerful, unopinionated, reactive library to enable quick and easy development of Discord bots for Java, Kotlin, and other JVM languages using the official Discord Bot API.
Java version of the Playwright testing and automation library
- playwright
- java
Java language binding for writing Appium Tests, conforms to W3C WebDriver Protocol
Make Slack and Facebook Bots in Java.
Open-source, self-hosted enterprise & site search server built on OpenSearch. Crawls web / file / DB / cloud sources, 20+ languages, REST API, and AI/RAG & semantic search. Apache-2.0.
- java
- elasticsearch
- full-text-search
- lucene
Java API For Chrome and Firefox
Slack Developer Kit (including Bolt for Java) for any JVM language
The Frank!Framework is an easy-to-use, stateless integration framework which allows (transactional) messages to be modified and exchanged between different systems.
- java
- system-integration
- open-source
- community-driven
This project focuses on automation of multi-level shadow root dom using java selenium. You can embed this plugin in your java selenium project.
- selenium
- selenium-webdriver
- selenium-java
- shadow-dom