Sign in

Repository Index

111,821 visible repositories in the index

Tags: Automation, bots, and scraping
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

553–576 of 1,122 · Most stars

AIL framework - Analysis Information Leak framework. Project moved to https://github.com/ail-project

  • ail-framework
  • information-leak
  • information-security
  • analysis

A Unix-style personal search engine and web crawler for your digital footprint.

  • search
  • poseidon
  • webcrawler
  • personal-search

Calibre new douban metadata source plugin. Douban no longer provides book APIs to the public, so it can only use web crawling to obtain data. This is a calibre Douban plugin based on web crawling.

Go HTTP client with browser-identical TLS/HTTP2 fingerprinting. Bypass bot detection by perfectly mimicking Chrome, Firefox, and Safari at the cryptographic level (JA3/JA4, Akamai fingerprint, header order). Supports HTTP/1.1, HTTP/2, HTTP/3, sessions, cookies, and proxies.

  • anti-bot
  • bot-detection
  • browser-fingerprint
  • browser-fingerprinting

Visual Blocks for ML is a Google visual programming framework that lets you create ML pipelines in a no-code graph editor. You – and your users – can quickly prototype workflows by connecting drag-and-drop ML components, including models, user inputs, processors, and visualizations.

Vocat is an open-source web control panel and engineering toolkit for Quectel EC20/EC25-class cellular modems. It combines modem discovery, live radio status, AT and USSD terminals, SMS, WiFi Calling, eSIM management, network selection, proxy routing, notifications, audit logs, and release automation in one self-contained service.

Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

  • python
  • lxml
  • xpath
  • xml

A high-performance Internet Relay Chat (IRCv3) server for UNIX-like and Windows systems

  • inspircd
  • c-plus-plus
  • irc-server
  • ircv3

Fast proxy scraper and checker written in Rust. Collects HTTP, SOCKS4 and SOCKS5 proxies from any number of sources, verifies each one really works, and writes JSON and plain text with response time, exit IP, ASN and geolocation. Single binary for Windows, Linux, macOS, Android, FreeBSD, NetBSD, illumos and Solaris, with an interactive TUI.

  • proxyscraper
  • proxyscrape
  • proxy-checker
  • proxy

Cinemagoer is a Python package useful to retrieve and manage the data of the IMDb (to which we are not affiliated in any way) movie database about movies, people and characters

  • imdb
  • movies
  • actors
  • cinema

一个功能强大的 Telegram 消息转发器,支持多源转发、关键词过滤、正则替换、RSS订阅,AI处理,多平台推送等功能。