Sign in

Repository Index

102,118 visible repositories in the index

Tags: Automation, bots, and scraping
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters (1)

Filters

Clear all filters

1–14 of 14 · Most stars

A Chrome DevTools Protocol driver for web automation and scraping.

  • cdp
  • chrome-headless
  • chrome-devtools
  • chrome-devtools-protocol

TranslatedAn API framework with a modular design based on Gin, which wraps commonly used features, is simple to use, and is dedicated to fast business development. For example, it supports cors cross-origin requests, jwt signature verification, zap log collection, panic exception capture, trace link tracing, prometheus monitoring metrics, swagger document generation, viper configuration file parsing, the gorm database component, the gormgen code generation tool, the graphql query language, errno unified definition of error codes, the use of gRPC, cron scheduled tasks, and so on.

  • golang
  • go
  • api-gin
  • gin

Point it at any web page and it finds the video, transcodes it, and streams it to your TV in real time. It even burns in subtitles.

Go HTTP client with browser-identical TLS/HTTP2 fingerprinting. Bypass bot detection by perfectly mimicking Chrome, Firefox, and Safari at the cryptographic level (JA3/JA4, Akamai fingerprint, header order). Supports HTTP/1.1, HTTP/2, HTTP/3, sessions, cookies, and proxies.

  • anti-bot
  • bot-detection
  • browser-fingerprint
  • browser-fingerprinting

Package cdp provides type-safe bindings for the Chrome DevTools Protocol (CDP), written in the Go programming language.

  • devtools-protocol
  • chrome-devtools-protocol
  • chrome-debugging-protocol
  • cdp

Extract structured data from web sites. Web sites scraping.

  • golang
  • golang-library
  • extract-data
  • chrome-fetcher