Sign in

Repository Index

70,234 visible repositories in the index

Tags: Automation, bots, and scraping
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

49–72 of 235 · Most stars

Build databases, automations, apps & agents with AI — no code. Open source platform available on cloud and self-hosted. GDPR, HIPAA, SOC 2 compliant. Best Airtable alternative.

  • online-database
  • no-code
  • airtable
  • database

TranslatedAn API framework with a modular design based on Gin, which wraps commonly used features, is simple to use, and is dedicated to fast business development. For example, it supports cors cross-origin requests, jwt signature verification, zap log collection, panic exception capture, trace link tracing, prometheus monitoring metrics, swagger document generation, viper configuration file parsing, the gorm database component, the gormgen code generation tool, the graphql query language, errno unified definition of error codes, the use of gRPC, cron scheduled tasks, and so on.

  • golang
  • go
  • api-gin
  • gin

EyeWitness is designed to take screenshots of websites, provide some server header info, and identify default credentials if possible.

TranslatedHands-on 🐍 web crawlers for many kinds of websites and e-commerce data 🕷. Includes 🕸: Taobao products, WeChat official accounts, Dianping, Qichacha, job recruitment sites, Xianyu, Alibaba tasks, Cnblogs, Weibo, Baidu Tieba, Douban movies, Baotu (ibaotu.com), Quanjing (quanjing.com), Douban music, a provincial drug administration, Sohu News, machine learning text collection, FOFA asset collection, Autohome, National Bureau of Statistics, Baidu keyword indexed-page counts, spider pool directories, Toutiao (Today's Headlines), Douban movie reviews, Ctrip, Xiaomi App Store, Anjuke, Tujia homestays ❤️❤️❤️. WeChat crawler showcase project:

  • python3
  • crawler
  • baidu-tieba
  • taobao-spider

Translated强国通 (Qiangguotong, "Strong Nation Pass") 科技强国 (Keji Qiangguo, "Technology Strong Nation") 学习强国 (Xuexi Qiangguo, "Study Strong Nation") xuexiqiangguo The best-to-use open-source web-based 学习强国 (Xuexi Qiangguo) assistant on the whole web: TechXueXi (a lazy person's point-farming tool, automatic study) 技术强国 (Jishu Qiangguo, "Technology Strong Nation"), supports answering quiz questions, supports docker, 45 points/day

TranslatedBased on Dineshkarthik's project. Cross-platform, supports viewing download progress on the web, supports issuing download commands via bot, supports downloading from private groups that have already been joined even when downloading of their resources is restricted. telegram media download,Download media files from a telegram conversation/chat/channel up to 2GiB per file

  • media-downloader
  • flask
  • cross-platform
  • downloader

🎬 Open-source, self-hosted AI agent that runs a YouTube channel end to end: researches topics, writes scripts, generates narration, visuals and video, optimizes SEO, and publishes after your approval, then learns from analytics. Works with Gemini, OpenAI, OpenRouter, DeepSeek and more.

Extract any website's complete design system with one command. DTCG tokens, semantic+primitive+composite, MCP server for Claude Code/Cursor/Windsurf, multi-platform emitters (iOS SwiftUI, Android Compose, Flutter, WordPress), Tailwind v4, Figma variables, shadcn/ui, CSS health audit, WCAG remediation, Chrome extension. MIT, Playwright, Node 20+.

TranslatedZotero translators for Chinese web page scraping 🎉 This is Zotero translators for Chinese Sites(beta), not the official Zotero repo

  • zotero
  • translators
  • javascript
  • cnki

TranslatedAn open-source AI agent for social media — discover trends, create content, publish everywhere, and learn what works across Xiaohongshu, Douyin, Zhihu, Bilibili, and more.🎨

An agentic extractor for messaging platforms. Noria receives messages & URLs via chat; scrapes web data to evaluate the content against custom scoring matrices (e.g., jobs, scholarships); and sends a structured summary with a calculated match score directly to the assigned messenger number.

CISO Assistant is a one-stop-shop GRC platform for Risk Management, AppSec, Compliance & Audit, TPRM, BIA, Privacy, and Reporting. It supports 200+ global frameworks with automatic control mapping, including ISO 27001, NIST CSF, SOC 2, CIS, PCI DSS, NIS2, DORA, GDPR, HIPAA, CMMC, and more.

  • compliance
  • grc
  • soc2
  • gdpr

TranslatedAI customer service bot for Pinduoduo, Qianniu, and Doudian: automatically replies to customer inquiries, answers product questions, and handles after-sales appeals; supports unified reception across multiple platforms such as WeChat, Xiaohongshu, JD.com, Douyin, Bilibili, and Weibo; can connect to large models such as DeepSeek / Tongyi Qianwen (Qwen), and supports customization with your own knowledge base.

A scalable social community platform powered by Gin backend and modern TypeScript/Vue frontend architecture

Official Repository: Telegram bot which can download direct links, torrents, nzb, google drive, telegram document, any file/folder from rclone supported clouds, all yt-dlp supported sites and jdownloader supported sites, then upload them to google drive, telegram cloud or to one of rclone supported clouds

  • mirror
  • leech
  • clone
  • mega