Python scraper based on AI
- scraping
- scraping-python
- llm
- web-crawler
Repository Index
47,133 repositories indexed
25–48 of 717 · Most stars
Python sample codes and textbook for robotics algorithms.
An autonomous agent that conducts deep research on any data using any LLM providers
- ai
- python
- agent
- automation
The headless browser for AI agents and web scraping
- antidetect
- antidetect-browser
- browser
- browser-automation
Helping you select a JavaScript framework - Todo apps for React.js, Angular, Vue and many more
🤖 Headless UI for building powerful tables & datagrids for TS/JS - React-Table, Vue-Table, Solid-Table, Svelte-Table
- react
- table
- datagrid
- datatable
A library for building fast, reliable and evolvable network services.
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
- web-scraping
- web-crawling
- npm
- headless-chrome
The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.
Elegant Scraper and Crawler Framework for Golang
SpiderFoot automates OSINT for threat intelligence and mapping your attack surface.
- footprinting
- osint
- threatintel
- python
TranslatedWords learning and English muscle memory training software designed for keyboard workers
- english-learning
- typing-practice
- typing-game
- typingspeedtest
Saleor Core: the high performance, composable, headless commerce API.
- python
- store
- commerce
- shop
Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
- browser
- rust
- servo
- browser-automation
Adds static typing to JavaScript to improve developer productivity and code quality.
TranslatedSelf-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
The most customizable typing website with a minimalistic design and a ton of features. Test yourself in various modes, track your progress and improve your speed.
- monkeytype
- typingtest
Optional static typing for Python
- python
- types
- typing
- typechecker
TranslatedA mini program development framework based on Vue.js, supporting Vue.js syntax and the build tool ecosystem at the底层 level.
- mpvue
- vue
- wxmp
- weapp
🎮 A step-by-step guide to implementing SSAO, depth of field, lighting, normal mapping, and more for your 3D game.
An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models. The goal of this repo is to provide the simplest implementation of a deep research agent - e.g. an agent that can refine its research direction overtime and deep dive into a topic.
TranslatedCAT, as a basic component for server-side projects, provides multi-language clients for Java, C/C++, Node.js, Python, Go, etc. It has been deeply integrated into Meituan Dianping's infrastructure middleware frameworks (MVC framework, RPC framework, database framework, cache framework, etc., message queue, configuration system, etc.), providing Meituan Dianping's business lines with a rich set of system performance metrics, health status, real-time alerts, and more.
- apm
- java
- distributed
- realtime
A lightweight and modular front-end framework for developing fast and powerful web interfaces
Turn any website into a structured API. Extract, automate, search and monitor the web.
- automation
- no-code
- scraper
- web-scraper