Scrapy, a fast high-level web crawling & scraping framework for Python.
- python
- scraping
- crawling
- framework
132,241 visible repositories in the index
25–48 of 4,051 · Most stars
Scrapy, a fast high-level web crawling & scraping framework for Python.
Translated⭐AI-driven public opinion & trend monitor with multi-platform aggregation, RSS, and smart alerts.🎯 Say goodbye to information overload, your AI public opinion monitoring assistant and trending topic filtering tool! Aggregates trending topics from multiple platforms + RSS subscriptions, and supports precise keyword filtering. AI smart news filtering + AI translation + AI analysis briefings pushed straight to your phone, and it can also connect to the MCP architecture, enabling AI natural language conversational analysis, sentiment insight, trend prediction, and more. Supports Docker, with data kept locally or in the cloud under your own control. Integrates smart push notifications through channels such as WeChat/Feishu/DingTalk/Telegram/email/ntfy/bark/slack.
Ultralytics YOLO27, YOLO26, YOLO11, YOLOv8 — object detection, instance segmentation, semantic segmentation, image classification, pose estimation, object tracking
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
Debloat any Android or Google TV over Wi-Fi and get an Apple TV-style home.
A no-code RAG server that keeps answers in sync with your documents. Works with 8 vector databases. Built on Pathway.
A hand-picked collection of the finest of resources for the most awesome of agents, Claude Code, the undisputed champion of coding companions, from the unstoppable team at Anthropic PBC (no affiliation). A delectable showcase of top tier skills, ambidextrous agents, scintillating status lines, top notch developer tooling, and also we have plugins
Rich is a Python library for rich text and beautiful formatting in the terminal.
We write your reusable computer vision tools. 💜
Qlib is an AI-oriented Quant investment platform that aims to use AI tech to empower Quant Research, from exploring ideas to implementing productions. Qlib supports diverse ML modeling paradigms, including supervised learning, market dynamics modeling, and RL, and is now equipped with https://github.com/microsoft/RD-Agent to automate R&D process.
3,000+ reusable AI agent skills for Claude Code, Codex, Cursor and Gemini CLI. AAS Core adds local catalog discovery, agent-owned selection and plan preview. CLI, MCP and plugins.
AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨
An interactive TLS-capable intercepting HTTP proxy for penetration testers and software developers.
Developer-first error tracking and performance monitoring
A community-maintained Python framework for creating mathematical animations.
The uncompromising Python code formatter
the only cheat sheet you need
🕵️♂️ Collect a dossier on a person by username from 6K websites
Convert PDF to markdown + JSON quickly with high accuracy
:hedgehog: PostHog is the leading platform for building self-driving products. Our developer tools – AI observability, analytics, session replay, flags, experiments, error tracking, logs, and more – capture all the context agents need to diagnose problems, uncover opportunities, and ship fixes. Steer it all from Slack, web, desktop, or the MCP.
SearXNG is a free internet metasearch engine which aggregates results from various search services and databases. Users are neither tracked nor profiled.
SGLang is a high-performance serving framework for large language models and multimodal models.
"Vibe-Trading: Your Personal Trading Agent"