Python scraper based on AI
- scraping
- scraping-python
- llm
- web-crawler
77,852 visible repositories in the index
25–48 of 692 · Most stars
Python scraper based on AI
Local-first code intelligence graph for MCP and CLI. Builds a persistent map of your codebase so AI coding tools read only what matters, with benchmarked context reductions on reviews and large-repo workflows.
The batteries-included agent harness.
An autonomous agent that conducts deep research on any data using any LLM providers
TranslatedMaple Mono: Open source monospace font with round corner, ligatures and Nerd-Font icons for IDE and terminal, fine-grained customization options. Rounded-corner monospace font with ligatures and terminal icons, with a perfect 2:1 width ratio between Chinese and English characters, and fine-grained customization options
We have made you a wrapper you can't refuse
Minimal examples of data structures and algorithms in Python
Image-to-Image Translation in PyTorch
Original reference implementation of "3D Gaussian Splatting for Real-Time Radiance Field Rendering"
Graph Neural Network Library for PyTorch
Saleor Core: the high performance, composable, headless commerce API.
TranslatedA Python web scraping tutorial series, learning Python web scraping from 0 to 1, including browser packet capture and mobile APP packet capture with tools such as fiddler and mitmproxy, the use of the various modules involved in web scraping, such as requests, beautifulSoup, selenium, appium, scrapy, etc., as well as IP proxies, CAPTCHA recognition, using Mysql and MongoDB databases with Python, multi-threaded and multi-process scraping, reverse engineering and cracking of CSS scraping encryption, JS scraping reverse engineering, distributed scraping, practical scraping project examples, etc.
Translated100-Days-Of-ML-Code Chinese version
TranslatedSelf-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
Rebuild the object in a reference image as a code-only, procedural, quality-gated, animation-ready Three.js model. Token-efficient image-to-3D.
The interactive graphing library for Python :sparkles:
Network Analysis in Python
Air-gapped, privacy-focused, open-source NotebookLM alternative. AI agent that researches, transforms, and edits your documents. Join our Discord: https://discord.gg/ejRNvftDp9
Self-organizing AI second brain for Obsidian + Claude Code. Drop any source and Claude reads, links, and files it into one connected knowledge graph of plain Markdown you own. AI note-taking, personal knowledge management (PKM), and an open-source Notion alternative. Based on Karpathy's LLM Wiki pattern.
An API wrapper for Discord written in Python.
Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
Cockpit is a web-based graphical interface for servers.
Convert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs: