Sign in

Repository Index

55,640 visible repositories in the index

Tags: Automation, bots, and scraping
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters (1)

Filters

Clear all filters

1–7 of 7 · Most stars

An archiving tool with an IM-style interface that prioritizes privacy and accessibility, integrated with various archival services including Internet Archive, archive.today, Ghostarchive, IPFS, Telegraph, and file systems.

  • telegram
  • archive
  • wayback-machine
  • save-the-internet

Pagser is a simple, extensible, configurable parse and deserialize html page to struct based on goquery and struct tags for golang crawler

  • go
  • golang
  • goquery
  • colly

Seamlessly fetch paginated data from any source. Simple and high performance API scraping included!

  • api-scraper
  • indexer
  • pagination
  • paginator