Pholcus is a distributed high-concurrency crawler software written in pure golang
- spider
- crowler
96,838 visible repositories in the index
1–8 of 8 · Most stars
Pholcus is a distributed high-concurrency crawler software written in pure golang
TranslatedZotero translators for Chinese web page scraping 🎉 This is Zotero translators for Chinese Sites(beta), not the official Zotero repo
An agentic extractor for messaging platforms. Noria receives messages & URLs via chat; scrapes web data to evaluate the content against custom scoring matrices (e.g., jobs, scholarships); and sends a structured summary with a calculated match score directly to the assigned messenger number.
A guide for extracting titles, authors, and citations from Google Scholar using Python and Oxylabs SERP Scraper API.
Retrieve author and publication information from Google Scholar in a friendly, Pythonic way without having to worry about CAPTCHAs!
一个股票数据(沪深)爬虫和选股策略测试框架
Paste a link, get the whole marketing machine behind it: paid ads, organic social, SEO, Reddit, founders, funnel — evidence-cited. CLI, MCP server and a local web app that uses your Claude Code or Codex plan.
Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.