Sign in

Repository Index

70,234 visible repositories in the index

Tags: Browser automation
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

1–15 of 15 · Most stars

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.

EyeWitness is designed to take screenshots of websites, provide some server header info, and identify default credentials if possible.

Translated强国通 (Qiangguotong, "Strong Nation Pass") 科技强国 (Keji Qiangguo, "Technology Strong Nation") 学习强国 (Xuexi Qiangguo, "Study Strong Nation") xuexiqiangguo The best-to-use open-source web-based 学习强国 (Xuexi Qiangguo) assistant on the whole web: TechXueXi (a lazy person's point-farming tool, automatic study) 技术强国 (Jishu Qiangguo, "Technology Strong Nation"), supports answering quiz questions, supports docker, 45 points/day