Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
Repository Index
47,133 repositories indexed
1–13 of 13 · Most stars
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
- web-scraping
- web-crawling
- npm
- headless-chrome
The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.
Turn any website into a structured API. Extract, automate, search and monitor the web.
- automation
- no-code
- scraper
- web-scraper
OCR & Document Extraction using vision models
Zero-runtime Stylesheets-in-TypeScript
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
A pure javascript QR code reading library. This library takes in raw images and will locate, extract and parse any QR code found within.
- qrcode
- qr-parsing-library
- typescript
- qr
Self-hosted personal gallery application with online photo management and albums, supporting Live/Motion Photos, EXIF parsing, geolocation recognition, and an explore map.
- geocoding
- photo-gallery
- live-photo
- exif-extraction
Audio feature extraction for JavaScript.
- audio-features
- javascript
- feature-extraction
- spectral-centroid
Figmagic is the missing piece between DevOps and design: Generate design tokens, export graphics, and extract design token-driven React components from your Figma documents.
- figma
- figma-api
- design-specs
- design-tokens
:mag: Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript
Set of the String helpers extracted from DockYard's ember-composable-helpers.
- ember
- ember-addon
- ember-cli
- emberjs