Python scraper based on AI
- scraping
- scraping-python
- llm
- web-crawler
Repository Index
47,133 repositories indexed
25–48 of 713 · Most stars
Python sample codes and textbook for robotics algorithms.
An autonomous agent that conducts deep research on any data using any LLM providers
- ai
- python
- agent
- automation
The headless browser for AI agents and web scraping
- antidetect
- antidetect-browser
- browser
- browser-automation
Helping you select a JavaScript framework - Todo apps for React.js, Angular, Vue and many more
🤖 Headless UI for building powerful tables & datagrids for TS/JS - React-Table, Vue-Table, Solid-Table, Svelte-Table
- react
- table
- datagrid
- datatable
A library for building fast, reliable and evolvable network services.
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
- web-scraping
- web-crawling
- npm
- headless-chrome
The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.
Elegant Scraper and Crawler Framework for Golang
SpiderFoot automates OSINT for threat intelligence and mapping your attack surface.
- footprinting
- osint
- threatintel
- python
为键盘工作者设计的单词记忆与英语肌肉记忆锻炼软件 / Words learning and English muscle memory training software designed for keyboard workers
- english-learning
- typing-practice
- typing-game
- typingspeedtest
Saleor Core: the high performance, composable, headless commerce API.
- python
- store
- commerce
- shop
Adds static typing to JavaScript to improve developer productivity and code quality.
Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
- browser
- rust
- servo
- browser-automation
🚀 自托管的抖音、TikTok、B 站数据采集与无水印视频下载 API，支持 AI agent 通过 MCP 调用与离线语音转文字，Docker 一键部署。| Self-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
The most customizable typing website with a minimalistic design and a ton of features. Test yourself in various modes, track your progress and improve your speed.
- monkeytype
- typingtest
Optional static typing for Python
- python
- types
- typing
- typechecker
基于 Vue.js 的小程序开发框架，从底层支持 Vue.js 语法和构建工具体系。
- mpvue
- vue
- wxmp
- weapp
🎮 A step-by-step guide to implementing SSAO, depth of field, lighting, normal mapping, and more for your 3D game.
An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models. The goal of this repo is to provide the simplest implementation of a deep research agent - e.g. an agent that can refine its research direction overtime and deep dive into a topic.
CAT 作为服务端项目基础组件，提供了 Java, C/C++, Node.js, Python, Go 等多语言客户端，已经在美团点评的基础架构中间件框架（MVC框架，RPC框架，数据库框架，缓存框架等，消息队列，配置系统等）深度集成，为美团点评各业务线提供系统丰富的性能指标、健康状况、实时告警等。
- apm
- java
- distributed
- realtime
A lightweight and modular front-end framework for developing fast and powerful web interfaces
Turn any website into a structured API. Extract, automate, search and monitor the web.
- automation
- no-code
- scraper
- web-scraper