Sign in

Repository Index

132,241 visible repositories in the index

Tags: Web scraper
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

1–24 of 31 · Most stars

DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework

  • crawler
  • dotnetcore
  • cross-platform
  • csharp

Google Maps Scraper & Lead Generation Tool. Extract 50+ data points including business emails, phone numbers, and social profiles. Includes enrichment features, API access, and a generous free plan with 200 searches/month.

  • google-maps-scraping
  • google-maps
  • google-maps-api
  • google-maps-review

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

  • aitools
  • crawl
  • scrape
  • serp

Perplexity Scraper Track brand mentions, analyze rankings, and gain competitor intelligence from Perplexity. Get started in minutes.

  • ai-scraper
  • llm-api
  • llm-scraper
  • llm-scraping

Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.

Fast, robust Google Flights scraper (API) for Python. (Probably)

  • airport
  • flights
  • google-flights
  • google-flights-api

A research tool for visually exploring Bureau of Labor Statistics Occupational Outlook Handbook data. This is not a report, a paper, or a serious economic publication — it is a development tool for exploring BLS data visually.

从 Andrej Karpathy 推荐的 90 顶级技术博客中抓取最新文章,AI 多维评分筛选,生成一份每日精选日报。更多可见公众号:懂点儿AI

Self-hosted web search for AI agents and SEO. Google, Bing, Yandex, Baidu, DuckDuckGo & Ecosia, rendered in a real browser: ranked results and clean page Markdown. API, CLI, MCP 🎉

  • baidu
  • google
  • serp
  • serpapi

AgentQL is a suite of tools for connecting your AI to the web. Featuring a query language and Playwright integrations for interacting with elements and extracting data quickly, precisely, and at scale. Includes REST API, Python and JavaScript SDKs, browser debugger.

小红书数据采集、网站图片、视频资源批量下载工具,颜值超高的数据采集工具(批量下载,视频提取,图片)Telegram:https://t.me/+ZtLSwuIKTo44MDY1

  • downloader
  • wpf
  • wpf-ui
  • wpf-notifyicon

Effortlessly extract data with our AI scraper API. Simplify data extraction, get clean JSON outputs and adapt to page changes. Try it free today!

  • ai-data-extraction
  • ai-scraper
  • ai-web-scraper
  • data-extraction