Sign in

Repository Index

140,194 visible repositories in the index

Tags: Automation, bots, and scraping
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters (1)

Filters

Clear all filters

1–24 of 111 · Most stars

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.

TranslatedSelf-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.

💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants

Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audio codec.

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.

Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across Speech to Speech or LLM/STT/TTS, with a visual workflow builder, MCP native and telephony support.

  • conversational-ai
  • open-source
  • outbound-calls
  • pipecat

TranslatedAI Vtuber is a virtual streamer [Live2D/UE/xuniren] powered by [ChatterBot/ChatGPT/claude/langchain/chatglm/text-gen-webui/闻达 (Wenda)/千问 (Qianwen)/kimi/ollama]. It can interact with viewers in real time in live streams on [Bilibili/抖音 (Douyin)/快手 (Kuaishou)/微信视频号 (WeChat Channels)/拼多多 (Pinduoduo)/斗鱼 (Douyu)/YouTube/twitch/TikTok], or chat directly on the local machine. It uses TTS technology [edge-tts/VITS/elevenlabs/bark/bert-vits2/睿声 (Ruisheng)] to generate replies and can optionally change the voice with [so-vits-svc/DDSP-SVC]; commands work together with SD to draw images.

Intelligent proxy pool for Humans™ to extract content from the internet and build your own Large Language Models in this new AI era

  • crawler
  • python3
  • scylla
  • proxy-pool

Open-source AI humanizer: rewrite AI-generated text into natural, human-sounding prose. LLM rewriting + multi-engine translation, with step-by-step traces. Python CLI, n8n & Docker.

  • ai-humanizer
  • humanize-text
  • ai-tools
  • text-humanizer

Free Trial Amazon Scraper API for extracting search, product, offer listing, reviews, question and answers, best sellers and sellers data.

  • amazon-scraper
  • amazon-scraping
  • e-commerce-api
  • web-scraping