Sign in

Repository Index

132,241 visible repositories in the index

Tags: Web scraper
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

1–24 of 38 · Most stars

TranslatedA multi-task real-time/scheduled monitoring and intelligent analysis system for Xianyu (闲鱼), built with Playwright and AI, and equipped with a full-featured back-end management UI. It helps users find the products they like among the vast number of items on Xianyu.

Google Maps Scraper & Lead Generation Tool. Extract 50+ data points including business emails, phone numbers, and social profiles. Includes enrichment features, API access, and a generous free plan with 200 searches/month.

  • google-maps-scraping
  • google-maps
  • google-maps-api
  • google-maps-review

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

  • aitools
  • crawl
  • scrape
  • serp

Use Google News Scraper API to obtain the latest global news for your project, including a wide range of sources, headlines, URLs, and publication dates from the Google News platform.

  • google-news-scraper
  • google-scraper
  • google-scraper-api
  • news-scraper

Free, open-source Google Maps scraper for lead generation (Python, no API key, no Docker). Exports name, phone, email, website, rating and Instagram/Facebook/LinkedIn/TikTok/YouTube/X links to CSV. 100 places with emails in 44 s; --grid beats Google's 120 cap. MX email check, ad-pixel detection. Skill for Claude Code, Codex and Cursor.

  • b2b-leads
  • claude-code
  • google-maps
  • google-maps-scraper

Fast, robust Google Flights scraper (API) for Python. (Probably)

  • airport
  • flights
  • google-flights
  • google-flights-api

Real time google image scraper. The process is automated by sending HTTP requests to retrieve image data which is then parsed and saved.

  • google-image-scraper
  • google-images-crawler
  • image-scrape
  • image-scraper

Scrapes flight data from Google Flights and analyzes flight prices with Python and Oxylabs’ Google Flights API.

  • google-flights-api
  • google-flight-api
  • google-flights-api-python
  • google-flights-python

Retrieve author and publication information from Google Scholar in a friendly, Pythonic way without having to worry about CAPTCHAs!

  • scholar
  • googlescholar
  • scholarly-articles
  • scholarly-communications

Google Play Scraper for collecting public details about applications, games, movies & TV shows, books, and more.

  • google
  • google-play
  • google-play-api
  • google-play-scraper

This code is used to perform web scraping and data extraction from Google Maps. It is particularly designed for obtaining information about businesses, including their name, address, website, phone number, reviews, and more.

  • chromium
  • data
  • data-scraping
  • google

Self-hosted web search for AI agents and SEO. Google, Bing, Yandex, Baidu, DuckDuckGo & Ecosia, rendered in a real browser: ranked results and clean page Markdown. API, CLI, MCP 🎉

  • baidu
  • google
  • serp
  • serpapi