Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
Repository Index
47,133 repositories indexed
1–24 of 65 · Most stars
💖🧸 Self hosted, you-owned Grok Companion, a container of souls of waifu, cyber livings to bring them into our worlds, wishing to achieve Neuro-sama's altitude. Capable of realtime voice chat, Minecraft, Factorio playing. Web / macOS / Windows supported.
- ai-vtuber
- live2d
- neuro-sama
- neurosama
✨ Innovative and open-source visualization application that transforms various data formats, such as JSON, YAML, XML and CSV into interactive graphs.
- json
- tool
- react
- visualization
Clone any website with one command using AI coding agents
Vane is an AI-powered answering engine.
- ai-search-engine
- search-engine
- open-source-ai-search-engine
- perplexica
The fast, flexible, and elegant library for parsing and manipulating HTML and XML.
🔥 Clone and recreate any website as a modern React app in seconds
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
- web-scraping
- web-crawling
- npm
- headless-chrome
The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.
Crawl a site to generate knowledge files to create your own custom GPT from a URL
LLM Wiki is a cross-platform desktop application that turns your documents into an organized, interlinked knowledge base — automatically. Instead of traditional RAG (retrieve-and-answer from scratch every time), the LLM incrementally builds and maintains a persistent wiki from your sources。
An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models. The goal of this repo is to provide the simplest implementation of a deep research agent - e.g. an agent that can refine its research direction overtime and deep dive into a topic.
Premium hand-crafted icons built by Ionic, for Ionic apps and web apps everywhere 🌎
Turn any website into a structured API. Extract, automate, search and monitor the web.
- automation
- no-code
- scraper
- web-scraper
Open-source AI agent for web automation. Use your real, logged-in browser to automate daily tasks.
🔥 A well-tested feature-rich modular Firebase implementation for React Native. Supports both iOS & Android platforms for all Firebase services.
A pack of more than 480 beautifully crafted Open Source icons. SVG, Sketch, Web Font and Animations support.
A scalable set of icons handcrafted with ❤️ by GitHub
- svg
- octicons
- octicons-helper
- gem
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
The A32NX & A380X Project are community driven open source projects to create free Airbus aircraft in Microsoft Flight Simulator that are as close to reality as possible.
- javascript
- a320
- rust
- reactjs
Craft AI-driven interface effortlessly🤖
✨ A feature-rich yet lightweight data-table crafted for Angular
- angular
- datatable
- table
- grid
TranslatedFree, open-source screen sharing for private live streams with friends. Watch together in a browser or self-host Piik. It supports game streaming, watching movies together, and self-hosting.
- p2p
- screen-sharing
- self-hosted
- webrtc
🌀 AI-native framework for building data portals. Scaffold a full portal from a brief and load datasets in minutes with agentic skills — any backend (CKAN, GitHub, Frictionless).
- data-portal
- ckan
- nextjs
- open-data-portal