Python scraper based on AI
- scraping
- scraping-python
- llm
- web-crawler
Repository Index
81,588 visible repositories in the index
1–22 of 22 · Most stars
An Open Phone Agent Model & Framework. Unlocking the AI Phone for Everyone
- agent
- phone-use-agent
TranslatedA multi-task real-time/scheduled monitoring and intelligent analysis system for Xianyu (闲鱼), built with Playwright and AI, and equipped with a full-featured back-end management UI. It helps users find the products they like among the vast number of items on Xianyu.
TranslatedHands-on 🐍 web crawlers for many kinds of websites and e-commerce data 🕷. Includes 🕸: Taobao products, WeChat official accounts, Dianping, Qichacha, job recruitment sites, Xianyu, Alibaba tasks, Cnblogs, Weibo, Baidu Tieba, Douban movies, Baotu (ibaotu.com), Quanjing (quanjing.com), Douban music, a provincial drug administration, Sohu News, machine learning text collection, FOFA asset collection, Autohome, National Bureau of Statistics, Baidu keyword indexed-page counts, spider pool directories, Toutiao (Today's Headlines), Douban movie reviews, Ctrip, Xiaomi App Store, Anjuke, Tujia homestays ❤️❤️❤️. WeChat crawler showcase project:
- python3
- crawler
- baidu-tieba
- taobao-spider
Python package for doing RPA
Allows you easily scan for and delete scam comments using several methods.
- youtube
- spam-filtering
A large model-based chatbot builder that can quickly integrate AI models (including ChatGPT, Claude, Gemini) into various software applications (such as Telegram, Gmail, Slack, and websites).
Intelligent proxy pool for Humans™ to extract content from the internet and build your own Large Language Models in this new AI era
- crawler
- python3
- scylla
- proxy-pool
基于 Nonebot2 开发，实现多平台适配和多Bot管理的，非常可爱的绪山真寻Bot
- qqbot
- nonebot
- nonebot2
- zhenxun
🥂 Gracefully face hCaptcha challenge with multimodal large language model.
- hcaptcha
- hcaptcha-solver
- yolo
- playwright
The best CLI client for Slack, because everything is terrible!
Tool to help us buy hard to find items.
Python package for scraping recipes data
- data-extraction
- food
- html-parsing
- json-ld
vulnx 🕷️ an intelligent Bot, Shell can achieve automatic injection, and help researchers detect security vulnerabilities CMS system. It can perform a quick CMS security detection, information collection (including sub-domain name, ip address, country information, organizational information and time zone, etc.) and vulnerability scanning.
- crawler
- information-gathering
- cms-detector
- cloudflare-detection
A Python based web application scanner to gather OSINT and fuzz for OWASP vulnerabilities on a target website.
- web
- application
- scanner
- osint
A Python library to utilize AWS API Gateway's large IP pool as a proxy to generate pseudo-infinite IPs for web scraping and brute forcing.
- security-tools
- security
- ip
- bypass
LinkedIn enumeration tool to extract valid employee names from an organization through search engine scraping
- webscraping
- python3
- osint
- enumeration
WikiChat is an improved RAG. It stops the hallucination of large language models by retrieving data from a corpus.
- natural-language-processing
- chatbot
- nlp
- factuality
A python tool used to discover endpoints, potential parameters, a target specific wordlist for a given target and secrets
Airut is a system for running Claude Code tasks from email and Slack. It handles workspace provisioning, container isolation, network sandboxing, session persistence, and cleanup — a secure foundation for autonomous agentic development.
Website to Scrapping all writeup from http://ctftime.org/ and you can organize which to read first!
Simple python matrix bot based on Matrix-nio