Converts HTTrack crawls to WARC files
- web-archiving
Repository Index
55,640 visible repositories in the index
121–133 of 133 · Most stars
Confluence Cloud to Markdown crawler with incremental updates and local link rewriting
The repository host gives no description.
SpiderMan,a base-on Broadway fast high-level web crawling & scraping framework for Elixir.
A Python DNS crawler to find identical domain names under different TLDs.
- python
- cybersecurity
- dns
- crawler
DuckDB extension to fetch pages from Wayback Machine & Common Crawl
- archived
- common-crawl
- duckdb
- duckdb-extension
German small and large versions of GPT2.
- gpt2
- german
- common-crawl
- machine-learning
A small FPS graphing utility for LOVE
:arrow_forward: A .NET core library to handle the login to Backpack.tf. Backpack.tf is a trading site for Team Fortress 2, Counter-Strike: Global Offensive, and Dota 2. Community item pricing, item trading and stats, and much more.
- teamfortress2
- steam
- steambot
- steamweb
A package to searching courses - Super Mario Maker
- json
- mario-maker
- nodejs
- javascript
:repeat: An API wrapper for the TF2 Outpost platform. A platform to find great deals for your Team Fortress 2, Counter-Strike: Global Offensive and Dota 2 items with zero hassle.
- teamfortress2
- steam
- steambot
- steam-api
Free WordPress AI traffic analytics and bot protection. See local crawler counts and identity evidence; protect forms, logins and WooCommerce checkout.
- anti-spam
- bot-detection
- php
- security
A package to fetching the maker profile - Super Mario Maker
- json
- mario-maker
- nodejs
- javascript