DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
- crawler
- dotnetcore
- cross-platform
- csharp
Repository Index
47,133 repositories indexed
25–48 of 75 · Most stars
Translated[Captcha Recognition - Training] This project is based on CNN/ResNet/DenseNet+GRU/LSTM+CTC/CrossEntropy to realize verification code identification. This project is only for training the model.
- captcha-recognition
- tensorflow-tutorials
- ocr
- tensorflow
Playwright that anti-bots cannot see, so no captchas: same API, anti-detect stealth headless Firefox, undetected fingerprint, bypass bot detection, Python web scraping and browser automation.
- datadome
- perimeterx
- akamai
- antidetect-browser
🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
Live Helper Chat - live support for your website. Featuring web and mobile apps, Voice & Video & ScreenShare. Supports Telegram, Twilio (whatsapp), Facebook messenger including building a bot.
- live-support
- chat-application
- chat
- livehelp
A community discussion platform: Brings together the main features from StackOverflow, Slack, Discourse, Reddit, and Disqus blog comments.
- forum
- questions-and-answers
- chat
- blog-comments
Async Python 3.6+ web scraping micro-framework based on asyncio
- asyncio
- aiohttp
- asyncio-spider
- crawler
Anemone web-spider framework
A configurable and extensible PHP web spider
:rocket: An open source alternative to searx which provides a modern-looking :sparkles:, lightning-fast :zap:, privacy respecting :disguised_face:, secure :lock: meta search engine
- meta-search-engine
- rust
- search-engine
- fast
Crawly, a high-level web crawling & scraping framework for Elixir.
A high performance web crawler / scraper in Elixir.
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
- xquery
- xml
- html
- json
LibreBooking is an open-source resource scheduling solution. It provides a flexible, mobile-friendly, and extensible interface for organizations to manage resource reservations. The "develop" branch contains the latest code of the project.
- resource-management
- scheduler
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Package cdp provides type-safe bindings for the Chrome DevTools Protocol (CDP), written in the Go programming language.
- devtools-protocol
- chrome-devtools-protocol
- chrome-debugging-protocol
- cdp
Extracts information about web pages, like youtube videos, twitter statuses or blog articles.
- php
- embed
- oembed
- opengraph
A AI Browser run any site JavaScript from Python with the real Firefox engine. Headless SpiderMonkey + Necko for automation and scraping.
- anti-bot
- automation
- firefox
- headless-browser
TranslatedOpen-source GrokBot alternative built on DeepSeek Harness. Build your personal bot team: multiple personal agents with persistent memory, identities and permissions, extensible through DSH plugins. MIT.
- dsh-plugin
- agent-memory
- ai-agent
- bot-marketplace
Cloudlog is a web-based amateur radio logging application built with PHP and MySQL. It supports a wide range of station logging activities, from HF to microwave, and integrates with companion tools for CAT control and automation.
- cloudlog
- ham-radio
- amateur-radio
- php
LINQ Provider for the Twitter API (C# Twitter Library)
- twitter-api
- twitter-library
- tweets
Run code inside a browser from the command line
- electron
- javascript
- chrome
- firefox
Get video info from Dailymotion, Vimeo, Wistia, and YouTube URLs.
A free Auction House bot for WoW Forever: buys low, posts high and undercuts for you. Windows app plus in-game panel.
- auction-house
- fan-project
- gold-making
- rust