🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
- wget
- browser-bookmarks
- pinboard
Repository Index
47,133 repositories indexed
1–24 of 37 · Most stars
Crawl a site to generate knowledge files to create your own custom GPT from a URL
Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
Connect APIs, remarkably fast. Free for developers.
- eventsourcing
- event-sourcing
- automation
- workflow
SuiteCRM - Open source CRM for the world
- crm
- php
- agplv3
- accounts
The extensible chat client.
- chat
- irc
- c
- extensible
Translated[Captcha Recognition - Training] This project is based on CNN/ResNet/DenseNet+GRU/LSTM+CTC/CrossEntropy to realize verification code identification. This project is only for training the model.
- captcha-recognition
- tensorflow-tutorials
- ocr
- tensorflow
Socioboard is world's first and open source Social Technology Enabler. Socioboard Core is our flagship product.
- social-media
- social-network
A framework to build Slack apps using Python
- slack
- slack-api
- bolt
- web-api
Crawly, a high-level web crawling & scraping framework for Elixir.
Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images...
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
- xquery
- xml
- html
- json
Chatbot in 200 lines of code using TensorLayer
- tensorlayer
- tensorflow
- chatbot
- rnn
Are you an early 🐤 or a night 🦉? Let's check out in gist
- pinned-gist
- awesome-pinned-gists
Ruby gem that fetches images and metadata from a given URL. Much like popular social website with link preview.
Get video info from Dailymotion, Vimeo, Wistia, and YouTube URLs.
A Oembed consumer library, that gives you information about urls. It helps you replace urls to youtube or vimeo for example, with their html embed code. It has advanced features like offline support, responsive embeds and caching support.
ChatGPT Telegram Bot running in AWS Lambda
- chatgpt
- aws-lambda
- openai
- python
Selfhosted. URL to PNG utility featuring parallel rendering using Playwright for screenshots and with storage caching via Local, S3, or CouchDB
Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.
- ai-agents
- browser-automation
- data-extraction
- firecrawl
A simple yet highly configurable Mastodon bot that posts geotagged aerial imagery of a random location in the world.
Extract URLs to stylesheets, scripts, links, images or HTML imports from HTML
Web spider as a service, spider on serverless
- web-spider
- serverless
- javascript
- api