A declarative struct-tag-based HTML unmarshaling or scraping package for Go built on top of the goquery library
- golang
- unmarshall
- goquery
- selectors
Repository Index
78,351 visible repositories in the index
289–312 of 327 · Most stars
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
- golang
- web-crawler
- crawling
- scraping
Playwright PHP library for browser automation: navigation, E2E tests, assertions, screenshots, and so much more!
- browser
- browser-automation
- php
- php-browser
Self-hosted, invisible CAPTCHA that detects AI agents driving real browsers. GDPR, WCAG 2.2 AA, and EAA: no cookies, no third-party data sharing, and no visual or audio puzzle. With a false-positive budget enforced in CI. Proof of work, drop-in for Turnstile and reCAPTCHA.
- anti-bot
- behavioral-analysis
- bot-detection
- captcha
X (Twitter) scraper API, MCP server & Claude skill to scrape tweets & followers. Not affiliated with X Corp.
- mcp
- mcp-server
- twitter-api
- x-api
Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.
- crawling
- csharp
- elixir
- ffi
🔥 A daily streak system & portfolio for your projects.
- summer-of-making
- nextjs
- hackclub
- hacktoberfest
Chemical Information from the Web
- rstats
- ropensci
- chemical-information
- webscraping
:mag: Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript
Search and read the web for AI agents at 99% fewer tokens. Free CLI + MCP.
Generate roxygen2 skeletons populated with information scraped from the function script.
MindAct: Community-Driven AI Agent for Claude, Obsidian, and RAG Knowledge Graphs
- activator
- analytics
- artificial-inteligence
- bigquery
Open field guide to 39 CAPTCHA types: identification signals, free and open-source bypass methods, and paid alternatives. Includes a searchable web version.
- captcha
- captcha-bypass
- captcha-solver
- captcha-tool
Pagser is a simple, extensible, configurable parse and deserialize html page to struct based on goquery and struct tags for golang crawler
- go
- golang
- goquery
- colly
一条命令把 GitHub 仓库或抖音视频变成竖屏讲解视频
- automation
- canvas
- chinese
- douyin
An app to search startup jobs scraped from websites written in Elixir, Phoenix, React and styled-components.
Scrapy project for data capture of vgchartz
The AI-native browser automation library. Snapshot + ref targeting — born from OpenClaw, built for agents, by agents.
Search the web and primary sources, read full pages, and check every citation. MCP server for Claude, Cursor, Codex and more. Runs on your machine.
Webpage summary extractor using Facebook Open Graph and arc90's readability
- readability
- scraper
- opengraph
Clone of Flappy Bird game in JavaScript and Canvas 2D
Physical Bitcoin Stat Ticker
Video game review datasets scraped from the Steam website (http://store.steampowered.com/). Data includes review text, number of hours that the reviewer played the game, number of friends, groups, etc.
:eyeglasses: Stream for rendering audio data