A AI Browser run any site JavaScript from Python with the real Firefox engine. Headless SpiderMonkey + Necko for automation and scraping.
- anti-bot
- automation
- firefox
- headless-browser
Repository Index
47,133 repositories indexed
25–43 of 43 · Most stars
Extract structured data from web sites. Web sites scraping.
- golang
- golang-library
- extract-data
- chrome-fetcher
Official UnrealIRCd repository. Downloads are available from our site
- irc-server
- ircv3
- sasl
- irc
Ruby gem that fetches images and metadata from a given URL. Much like popular social website with link preview.
Scrape/Crawl article from any site automatically. Make any web page readable, no matter Chinese or English.
Scrape any website, article or RSS/Atom Feed with ease!
- scrape
- elixir
- readability
- rss
🩵 Self-hosted & Fully-automated ActivityPub Bridge for Static Sites.
- activitypub
- federation
- fediverse
- rust
Mac app for website auditing and crawling
- seo
- website-auditing
- swift
- mac
Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.
- crawling
- csharp
- elixir
- ffi
An app to search startup jobs scraped from websites written in Elixir, Phoenix, React and styled-components.
Uses parselets and rwget to generate csv files from websites
Pre-rendering for JavaScript websites that delivers SSR-level SEO, enhanced link previews, and performance via effortless middleware integration — ideal for PWAs, SPAs, and modern JS-driven apps, websites, and webpages
- meteor
- middleware
- crawler
- seo
Website to Scrapping all writeup from http://ctftime.org/ and you can organize which to read first!
BNETDocs, the documentation and discussion website for Blizzard protocols
- battle-net
- blizzard
- bot
- diablo
Go package for scraping website recipes
- go
- golang
- recipe
- recipes
A PHP project to check if websites are linking to your website
- php
- competitors
- seo
- seo-optimization
:arrow_forward: A .NET core library to handle the login to Backpack.tf. Backpack.tf is a trading site for Team Fortress 2, Counter-Strike: Global Offensive, and Dota 2. Community item pricing, item trading and stats, and much more.
- teamfortress2
- steam
- steambot
- steamweb
A package to searching courses - Super Mario Maker
- json
- mario-maker
- nodejs
- javascript
Sitecore Content Hub Asset Importer. Allows importing image assets from various data sources into Sitecore Content Hub.