Repository Index

scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

• golang
• google-maps-scraping
• web-scraper
• web-scraping

The AI local media metadata crawler

• emby
• kodi
• plex
• python

TranslatedWeChat HOOK, WeChat robot, wxhook, database decryption, WeChat official account collection, WeChat official account crawler, WeCom (Enterprise WeChat) HOOK

• wechat
• wechatrobot
• wechatapi
• wxhook

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

• web-scraping
• text-extraction
• nlp
• html2text

Turn any webpage into structured data using LLMs

• ai
• browser
• gpt
• langchain

Low-code backend platform. Manage database on spreadsheet-like UI and build cloud functions workflows in JS/TS, all in your browser.

• firebase
• firestore
• backend
• cloud-functions

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

• crawler
• javascript
• spider
• extract-data

Build databases, automations, apps & agents with AI — no code. Open source platform available on cloud and self-hosted. GDPR, HIPAA, SOC 2 compliant. Best Airtable alternative.

• online-database
• no-code
• airtable
• database

Official Bright Data CLI - scrape, search, and extract structured web data directly from your terminal.

The All in One Framework to Build Undefeatable Scrapers

• anti-bot
• anti-detection
• cloudflare-bypass
• cloudflare-scrape

Agent-ready RPA suite with out-of-the-box automation tools. Built for individuals and enterprises.

• agent
• ai
• automation
• enterprise

TikTok Scraper. Download video posts, collect user/trend/hashtag/music feed metadata, sign URL and etc.

Open-Source Unified Vulnerability Management, DevSecOps & ASPM

• python
• vulnerability-databases
• django
• security

A collection of small corpuses of interesting data for the creation of bots and similar stuff.

• language
• words
• bots
• corpus

:zap: A distributed crawler for weibo, building with celery and requests.

• weibospider
• data-analysis
• python3
• distributed-crawler

Swiss-army tool for scraping and extracting data from online assets, made for hackers

• css
• curl
• gjson
• json

TranslatedSina Weibo crawler: uses Python to crawl Sina Weibo data and download Weibo images and Weibo videos

• weibo
• crawler
• weibo-spider

A library that scrapes Linkedin for user data

• linkedin
• linkedin-scraper
• scraper
• profile

An agentic extractor for messaging platforms. Noria receives messages & URLs via chat; scrapes web data to evaluate the content against custom scoring matrices (e.g., jobs, scholarships); and sends a structured summary with a calculated match score directly to the assigned messenger number.

• ai-agent
• automation
• data-extraction
• event-driven-architecture

GPP is Android's unofficial release automation Gradle Plugin. It can do anything from building, uploading, and then promoting your App Bundle or APK to publishing app listings and other metadata.

• android-development
• play-store
• gradle-plugin
• gpp

Datascraper that is currently adult focused - Updated regularly

• onlyfans
• datascraping
• scraper
• archive

Fully functional Twitter clone built in flutter framework using Firebase realtime database and storage

• twitter
• twitter-clone
• flutter-apps
• social

Downloads albums from the web in bulk for archive purposes

• ripme
• java
• album
• downloader

Google Maps Scraper & Lead Generation Tool. Extract 50+ data points including business emails, phone numbers, and social profiles. Includes enrichment features, API access, and a generous free plan with 200 searches/month.

• google-maps-scraping
• google-maps
• google-maps-api
• google-maps-review