Sign in

Repository Index

58,632 visible repositories in the index

Tags: Automation, bots, and scraping
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

1–24 of 45 · Most stars

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

TranslatedWeChat all-platform .NET SDK, Senparc.Weixin for C#, supporting .NET Framework, .NET Core, and .NET 10.0. Already supports all platforms including WeChat Official Accounts, Mini Programs, Mini Games, WeChat Pay, WeCom (Enterprise WeChat)/Enterprise Accounts, Open Platform, JSSDK, and WeChat peripherals. WeChat SDK for C#.

  • wechat
  • wechat-sdk
  • c-sharp
  • sdk

TranslatedINFO-SPIDER is a crawler toolbox 🧰 that brings many data sources together in one place, designed to help users get their own data back safely and quickly. The tool's code is open source and the process is transparent. Supported data sources include GitHub, QQ Mail, NetEase Mail, Alibaba Mail, Sina Mail, Hotmail, Outlook Mail, JD.com, Taobao, Alipay, China Mobile, China Unicom, China Telecom, Zhihu, Bilibili, NetEase Cloud Music, QQ friends, QQ groups, generating a Moments (WeChat friend circle) photo album, browser browsing history, 12306, cnblogs (博客园), CSDN blog, OSChina blog, Jianshu.

🔥 The fastest and powerful Python library for Instagram Private API 2026 with HikerAPI SaaS

  • instagram-api
  • instagram
  • instagram-client
  • instagram-downloader

TranslatedSync articles to multiple content platforms with one click. Supports major platforms including Toutiao (今日头条), WordPress, Zhihu (知乎), Jianshu (简书), Juejin (掘金), CSDN, and typecho. Publish once, sync to multiple platforms. Free up personal productivity.

  • chrome-extension
  • chrome
  • markdown
  • multiplatform

TranslatedHands-on 🐍 web crawlers for many kinds of websites and e-commerce data 🕷. Includes 🕸: Taobao products, WeChat official accounts, Dianping, Qichacha, job recruitment sites, Xianyu, Alibaba tasks, Cnblogs, Weibo, Baidu Tieba, Douban movies, Baotu (ibaotu.com), Quanjing (quanjing.com), Douban music, a provincial drug administration, Sohu News, machine learning text collection, FOFA asset collection, Autohome, National Bureau of Statistics, Baidu keyword indexed-page counts, spider pool directories, Toutiao (Today's Headlines), Douban movie reviews, Ctrip, Xiaomi App Store, Anjuke, Tujia homestays ❤️❤️❤️. WeChat crawler showcase project:

  • python3
  • crawler
  • baidu-tieba
  • taobao-spider

Jobs scraper library for LinkedIn, Indeed, Glassdoor, ZipRecruiter, Bayt, Naukri, BDJobs & HelloWork

  • indeed
  • linkedin
  • ziprecruiter
  • jobs-scraper

TranslatedAI Vtuber is a virtual streamer [Live2D/UE/xuniren] powered by [ChatterBot/ChatGPT/claude/langchain/chatglm/text-gen-webui/闻达 (Wenda)/千问 (Qianwen)/kimi/ollama]. It can interact with viewers in real time in live streams on [Bilibili/抖音 (Douyin)/快手 (Kuaishou)/微信视频号 (WeChat Channels)/拼多多 (Pinduoduo)/斗鱼 (Douyu)/YouTube/twitch/TikTok], or chat directly on the local machine. It uses TTS technology [edge-tts/VITS/elevenlabs/bark/bert-vits2/睿声 (Ruisheng)] to generate replies and can optionally change the voice with [so-vits-svc/DDSP-SVC]; commands work together with SD to draw images.

TranslatedSuper WeChat PC client, supports multiple instances, anti-message recall, voice message backup... open WeChatSDK

  • wechat
  • anti-revoke
  • multi-open

Vocat is an open-source web control panel and engineering toolkit for Quectel EC20/EC25-class cellular modems. It combines modem discovery, live radio status, AT and USSD terminals, SMS, WiFi Calling, eSIM management, network selection, proxy routing, notifications, audit logs, and release automation in one self-contained service.