Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
Repository Index
47,133 repositories indexed
1–24 of 88 · Most stars
The fast, flexible, and elegant library for parsing and manipulating HTML and XML.
A powerful JavaScript library for interacting with the Discord API
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
- web-scraping
- web-crawling
- npm
- headless-chrome
A WhatsApp client library for NodeJS that connects through the WhatsApp Web browser app
- whatsapp-web
- whatsapp-bot
- whatsapp-api
💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
- nlp
- machine-learning
- machine-learning-library
- bot
Python version of the Playwright testing and automation library.
- playwright
- chromium
- firefox
- webkit
TranslatedAV movie management system, avmoo, javbus, javlibrary crawler, online AV movie library, AV magnet link database, Japanese Adult Video Library, Adult Video Magnet Links - Japanese Adult Video Database
- javbus
- avmoo
- javlibrary
- spider
An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more
A framework agnostic PHP library to build chat bots
- chatbot
- botman
- bot-framework
- chatbot-framework
A Rust library for the Discord API.
- discord-api
- rust
- discord
- hacktoberfest
Mechanize is a ruby library that makes automated web interaction easy.
- scraping
- web
- ruby
A library to support tests with throwaway instances of Docker containers for all compatible .NET Standard versions.
- automation
- dotnet
- docker
- testcontainers
The most popular PHP library for use with the Twitter OAuth REST API.
- twitter-oauth
- php
- twitter-api
- php-library
DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
- crawler
- dotnetcore
- cross-platform
- csharp
Headless chrome/chromium automation library (unofficial port of puppeteer)
- automation
- puppeteer
- chromium
A node.js library for testing modern web applications
- testing-tools
- headless
- headless-browsers
- headless-chrome
xlwings is a Python library that makes it easy to call Python from Excel and vice versa. It works with Excel on Windows, macOS, and Excel on the web.
- python
- excel
- reporting
- automation
UI automation library for .Net
A browser testing and web crawling library for PHP and Symfony
.NET version of the Playwright testing and automation library.
- chrome
- chromium
- firefox
- webkit
PHP Captcha library
Java version of the Playwright testing and automation library
- playwright
- java
A NodeJS Discord library