🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.
Your lightweight open-source personal agent.
Python scraper based on AI
TranslatedSelf-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
Build voice agents with open-source models
Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audio codec.
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
An open source library for deep learning end-to-end dialog systems and chatbots.
Windows GUI Automation with Python (based on text properties)
- python
- automation
- ui-automation
- ui-automated-tests
Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across Speech to Speech or LLM/STT/TTS, with a visual workflow builder, MCP native and telephony support.
- conversational-ai
- open-source
- outbound-calls
- pipecat
TranslatedAI Vtuber is a virtual streamer [Live2D/UE/xuniren] powered by [ChatterBot/ChatGPT/claude/langchain/chatglm/text-gen-webui/闻达 (Wenda)/千问 (Qianwen)/kimi/ollama]. It can interact with viewers in real time in live streams on [Bilibili/抖音 (Douyin)/快手 (Kuaishou)/微信视频号 (WeChat Channels)/拼多多 (Pinduoduo)/斗鱼 (Douyu)/YouTube/twitch/TikTok], or chat directly on the local machine. It uses TTS technology [edge-tts/VITS/elevenlabs/bark/bert-vits2/睿声 (Ruisheng)] to generate replies and can optionally change the voice with [so-vits-svc/DDSP-SVC]; commands work together with SD to draw images.
Open-source MCP server for LinkedIn. Give Claude and any MCP-compatible AI agent access to profiles, companies, jobs, and messages.
A list of AI agents and robots to block.
喵币助手:双十一天猫(淘宝)、京东任务一键完成。电脑版,支持Android和HarmonyOS Next
Intelligent proxy pool for Humans™ to extract content from the internet and build your own Large Language Models in this new AI era
Open-source agentic security automation platform.
新闻网页正文通用抽取器 Beta 版.
- python3
- webcrawler
- webspider
Interact with your SQL database, Natural Language to SQL using LLMs
Open-source AI humanizer: rewrite AI-generated text into natural, human-sounding prose. LLM rewriting + multi-engine translation, with step-by-step traces. Python CLI, n8n & Docker.
- ai-humanizer
- humanize-text
- ai-tools
- text-humanizer
Free Trial Amazon Scraper API for extracting search, product, offer listing, reviews, question and answers, best sellers and sellers data.