Crawly, a high-level web crawling & scraping framework for Elixir.
Repository Index
47,133 repositories indexed
25–45 of 45 · Most stars
Web fetch, search, and crawl for AI agents. Built from scratch in Rust. No keys, no accounts. AGPL v3.
- agpl
- ai-agents
- anti-bot
- crawling
LibreBooking is an open-source resource scheduling solution. It provides a flexible, mobile-friendly, and extensible interface for organizations to manage resource reservations. The "develop" branch contains the latest code of the project.
- resource-management
- scheduler
Extract structured data from web sites. Web sites scraping.
- golang
- golang-library
- extract-data
- chrome-fetcher
Solve captcha without manually labeling a training set
- keras
- gan
- neural-network
- generative-adversarial-network
WarcDB: Web crawl data as SQLite databases.
TranslatedBullFlow — Open-source enterprise RAG solution: knowledge base → automated marketing content → omnichannel publishing. The entire knowledge base pipeline runs on local open-source models, with no paid models needed; AI Agent creates image-text posts / images / videos, with one-click publishing to 17 platforms including Douyin, Xiaohongshu, WeChat Official Accounts, LinkedIn, and YouTube. Commercial-grade, multi-tenant, billing & admin built in. MIT
- ai-agents
- bge-m3
- content-generation
- elasticsearch
PowerShell module for simple Slack integration
- slack
- powershell
- powershell-modules
- slack-sender
A declarative struct-tag-based HTML unmarshaling or scraping package for Go built on top of the goquery library
- golang
- unmarshall
- goquery
- selectors
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
- golang
- web-crawler
- crawling
- scraping
Mac app for website auditing and crawling
- seo
- website-auditing
- swift
- mac
Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.
- crawling
- csharp
- elixir
- ffi
Human-readable schedule expressions for .NET (C#): write "every day at 9am except sunday" instead of cron. Time zones, fluent builder, custom keywords, cron converter.
- cron
- csharp
- date-time
- dotnet
Clojure API for controlling a Chrome DevTools remote
Gatling Plugin for SBT
- gatling
- sbt
- sbt-plugin
- loadtesting
Gatling Plugin for Maven
- gatling
- maven
- maven-plugin
- loadtesting
Gatling Plugin for Gradle
- gatling
- gradle
- automation
- loadtesting
SpiderMan,a base-on Broadway fast high-level web crawling & scraping framework for Elixir.
A boilerplate for frontend projects powered by Gulp, HTML5 bolierplate, Sass, PostCss and Webpack(for Babel transpiling).
Lightweight Go SDK for Yandex Messenger Bot API — type-safe client with retry, rate-limit handling, and service-oriented architecture
- api-client
- bot
- bot-api
- chatbot
💻 Update a pinned gist to contain languages of your recent commits in GitHub
- gists
- github
- github-pro
- linguist