Python scraper based on AI
- scraping
- scraping-python
- llm
- web-crawler
47,133 repositories indexed
1–24 of 29 · Most stars
Python scraper based on AI
💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
ChatterBot is a machine learning, conversational dialog engine for creating chat bots
AutoHotkey - macro-creation and automation-oriented scripting utility for Windows.
TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
Translated:orange_book: Chinese Xinhua Dictionary database. Includes xiehouyu (two-part allegorical sayings), idioms, words, and Chinese characters.
Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more
SuiteCRM - Open source CRM for the world
Track GitHub trending repositories in your favorite programming language by native GitHub notifications!
Java language binding for writing Appium Tests, conforms to W3C WebDriver Protocol
Open-source, self-hosted enterprise & site search server built on OpenSearch. Crawls web / file / DB / cloud sources, 20+ languages, REST API, and AI/RAG & semantic search. Apache-2.0.
Open-source self-improving QA agent for software teams. A test harness with memory. Write tests in natural language for web and mobile. agent-qa learns from every run, adapts to UI changes, and catches regressions before you ship.
Slack Developer Kit (including Bolt for Java) for any JVM language
AI-powered E2E testing for 10 platforms. 253 MCP tools. Zero config. Works with Claude, Cursor, Windsurf, Copilot. Test Flutter, React Native, iOS, Android, Web, Electron, Tauri, KMP, .NET MAUI — all from natural language.
Extract knowledge from all information sources using gpt and other language models. Index and make Q&A session with information sources.
Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.
Rust language bindings for Microsoft Playwright
Human-readable schedule expressions for .NET (C#): write "every day at 9am except sunday" instead of cron. Time zones, fluent builder, custom keywords, cron converter.
A Library to parse natural language in pure Clojure and ClojureScript
Gentee - script programming language for automation. It uses VM and compiler written in Go (Golang).
TranslatedDeepSeek Blue Big Fat Fish Elimination Plan: a Chrome / Edge / Firefox browser extension that identifies and cleans up bot accounts (大肥鱼, Dafeiyu, "big fat fish") driven by the DeepSeek large model and AI agents in Bilibili comment sections. Offline rules + precise judgment by the DeepSeek API, AI comment detection, profile page identification, and one-click clearing by 鲸鱼娘 (Jingyuniang, "whale girl"). DeepSeek AI bot detector for Bilibili comments.
GPRbuild is an advanced build system designed to help automate the construction of multi-language systems.
:game_die: Native language APIs for building messages using the Slack Block Kit API