🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
Repository Index
47,133 repositories indexed
97–120 of 229 · Most stars
The repository host gives no description.
An archiving tool with an IM-style interface that prioritizes privacy and accessibility, integrated with various archival services including Internet Archive, archive.today, Ghostarchive, IPFS, Telegraph, and file systems.
- telegram
- archive
- wayback-machine
- save-the-internet
Get info from any web service or page
- opengraph
- twitter-cards
- embeds
- scraping
Messaging APIs for multi-platform
- messaging
- messenger
- line
- api-client
PufferPanel is an open source game server management panel, designed for both small networks and personal use
- game-server
- minecraft
- srcds
- panel
Socioboard is world's first and open source Social Technology Enabler. Socioboard Core is our flagship product.
- social-media
- social-network
Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
Java language binding for writing Appium Tests, conforms to W3C WebDriver Protocol
Open-source, self-hosted enterprise & site search server built on OpenSearch. Crawls web / file / DB / cloud sources, 20+ languages, REST API, and AI/RAG & semantic search. Apache-2.0.
- java
- elasticsearch
- full-text-search
- lucene
Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images...
Temporal Go SDK
- golang
- open-source
- workflow-engine
- workflow-automation
Web fetch, search, and crawl for AI agents. Built from scratch in Rust. No keys, no accounts. AGPL v3.
- agpl
- ai-agents
- anti-bot
- crawling
Free and open-source employee onboarding platform. Onboard new hires through Slack or the web portal.
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
- xquery
- xml
- html
- json
LibreBooking is an open-source resource scheduling solution. It provides a flexible, mobile-friendly, and extensible interface for organizations to manage resource reservations. The "develop" branch contains the latest code of the project.
- resource-management
- scheduler
Typed TypeScript SDK for direct and managed social platform integrations, with capability checks, explicit outcomes, and deterministic testing.
- api-integration
- bluesky
- bun
- developer-tools
Package cdp provides type-safe bindings for the Chrome DevTools Protocol (CDP), written in the Go programming language.
- devtools-protocol
- chrome-devtools-protocol
- chrome-debugging-protocol
- cdp
htmlquery is golang XPath package for HTML query.
- html
- xpath
- html-parser
- golang
:scissors: High performance, multi-threaded image scraper
Extracts information about web pages, like youtube videos, twitter statuses or blog articles.
- php
- embed
- oembed
- opengraph
Slack real time messaging and web API client in Elixir
Appium Server setup to automate android testing on real devices
A Python Package for the Google Chrome Dev Protocol [threading base]
- chrome-debugging-protocol
- python
- chrome
- headless