Scrapy Extension for monitoring spiders execution.
- scrapinghub
- scraping
- monitoring
- spiders
142,273 visible repositories in the index
1,009–1,032 of 1,136 · Most stars
Scrapy Extension for monitoring spiders execution.
A curated list of awesome packages, articles, and other cool resources from the Scrapy community.
Google Hangouts bot
NBA Stats API via Basketball Reference
A Python feed reader library.
ICP备案查询,可查询企业或域名的ICP备案信息,自动完成滑动验证,保存结果到Excel表格,适用于新版的工信部备案管理系统网站,告别频繁拖动验证,以及某站*工具要开通VIP才可查看备案信息的坑
Simple yet powerful automation stuffs.
Trigger is a robust network automation toolkit written in Python that was designed for interfacing with network devices.
DDC Converters 2.0: RVT/RFA to GLB, IFC4 and JSONL; IFC to Excel; DWG to Excel, DXF and SVG. Offline CLI and desktop apps, n8n workflows and AI-agent instructions.
Your own personal AIGC Factory. Any picture. Any reel. The Comfy way. ©️
Open workflow intelligence for discovering, validating, repairing, and generating automation workflows across frameworks — starting with n8n.
Jekyll-based static site for The Programming Historian
Telegram bot to stream videos in telegram voicechat for both groups and channels. Supports live steams, YouTube videos and telegram media. Supports scheduling streams, recording and many more.
Android automation from code. Test your apps on real phones, script the tasks you repeat, run a shelf of phones, or let an AI agent use one, from Python, Node.js, the CLI, HTTP or Appium clients. No ADB, no USB cable, no root.
Enable AI to control your desktop, mobile and HMI devices
Colored terminal output for Python's logging module
[ICLR 2026] RPG: A Repository Planning Graph for Unified and Scalable Codebase Generation
The only open-source toolkit that can download SEC EDGAR financial reports and extract textual data from specific item sections into nice & clean structured JSON files. Presented at WWW 2025 @ Sydney, Australia (https://dl.acm.org/doi/10.1145/3701716.3715289)
eBay Scraper for extracting product titles, descriptions, prices, specifications, customer reviews, and ratings from eBay
Translated✈️ Self-hosted multi-channel airfare price monitoring: flight detail collection → DingTalk rich-media push → four-layer strong alerts when the target price is met. Domestic routes and international routes (destinations on five continents) share the same collect-judge-push pipeline; data stays on your own machine, all configuration is done on a web page, open source and free.
Source-available, self-hosted platform for building AI agent flows - visual editor over a Django backend.
Clips Kitty: Free open-source AI video clipper. Local Opus Clip alternative (also Klap & Vizard) that turns Twitch, Kick & YouTube streams (GTA 6 too) into auto-captioned Shorts, Reels & TikToks, and can auto-post them 24/7 from a mini PC. Local AI (Ollama, Whisper): no usage or subscription fees. Or OpenRouter: a 2-hour VOD cost me 11 cents.
TranslatedA humanizing all-in-one plugin for AstrBot. It gives the bot a continuous human-like state, a daily life schedule, important dates, a diary, and low-frequency proactive messages. It includes 60+ practical features and a complete extension management page.
TranslatedAI live streaming room: Vidu S2 real-time digital human + danmaku (bullet comment) filtering and scheduling + wardrobe outfit changing + OBS overlay (character assets not included)