python爬虫教程系列、从0到1学习python爬虫，包括浏览器抓包，手机APP抓包，如 fiddler、mitmproxy，各种爬虫涉及的模块的使用，如：requests、beautifulSoup、selenium、appium、scrapy等，以及IP代理，验证码识别，Mysql，MongoDB数据库的python使用，多线程多进程爬虫的使用，css 爬虫加密逆向破解，JS爬虫逆向，分布式爬虫，爬虫项目实战实例等
- python3
- python-script
- python-spider
Repository Index
47,133 repositories indexed
1–17 of 17 · Most stars
SQL databases in Python, designed for simplicity, compatibility, and robustness.
- python
- sql
- sqlalchemy
- pydantic
An open source multi-tool for exploring and publishing data
A terminal spreadsheet multitool for discovering and arranging data
TinyDB is a lightweight document oriented database optimized for your happiness :)
🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library. Nothing like Michael Bolton.
- python
- utilities
- cache
- data-structures
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
Converting Can (Controller Area Network) Database Formats .arxml .dbc .dbf .kcd ...
- canbus
- python
- dbc
- arxml
pickleDB is an in memory key-value store using Python's orjson module for persistence. It can also use SQLite instead of orjson if needed.
- python
- python3
- pickledb
- database
Web tool for database management
- autocomplete
- database
- database-backup
- database-client
Open, source-backed catalog of computer-use agents: reviewed papers, GUI models, datasets, benchmarks, tools, and reusable JSONL/SQLite data.
- agent-evaluation
- agentic-ai
- ai-agents
- awesome
Schema and generated objects for biolink data model and upper ontology
- biolink
- monarchinitiative
- gene-ontology
- datamodel
Manage MongoDB servers and replica sets using JSON configurations!
AI-powered platform for OSINT intelligence analysis. Features archive discovery with hypothesis-driven investigation, GLiNER entity extraction, Mapbox geospatial visualization, network analysis, and document processing. Built with FastAPI, Next.js, Weaviate, and DSPy.
- ai-agents
- document-processing
- dspy
- entity-extraction
An async Python 3.11+ PocketBase SDK
- async
- database
- pocketbase
- python
A Python application to filter and transfer Zeek logs to Elastic/OpenSearch+Humio. This app can also output pure JSON logs to stdout for further processing!
- elasticsearch
- zeek
- opensearch
- python
A low-memory json-based database for MicroPython