🕵️♂️ Collect a dossier on a person by username from 6K websites
- osint
- social-network
- identification
- socmint
Repository Index
67,762 visible repositories in the index
1–24 of 26 · Most stars
Free, Open Source, Self-Hosted WhatsApp API Gateway
- api
- gateway
- self-hosted
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
- python
- news
- crawler
- crawling
Incredibly fast crawler designed for OSINT.
Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
Visual Development for React, Vue, Svelte, Qwik, and more
- react
- webcomponents
- wysiwyg
- frontend
One-stop Proxies Crawling and Aggregation Platform
- proxypool
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- web-scraping
- text-extraction
- nlp
- html2text
All in one tool for Information Gathering, Vulnerability Scanning and Crawling. A must have tool for all penetration testers
- scanner
- crawler
- information-gathering
- admin-scanner
GoClaw - GoClaw is OpenClaw rebuilt in Go — with multi-tenant isolation, 5-layer security, and native concurrency. Deploy AI agent teams at scale without compromising on safety.
freehire — the open-source search engine for job seekers
- ats
- careers
- hiring
- job-aggregator
A metasearch library that aggregates results from diverse web search services
- python
- search
- metasearch
- ddgs
This is a lightweight, headless browser purpose-built for AI agents (such as Codex or Claude Code) to perform browser automation tasks; it is designed to navigate through various web protection systems, login processes, and reverse-engineering scenarios
- anti-bot
- automation
- firefox
- headless-browser
WKZombie is a Swift framework for iOS/OSX to navigate within websites and collect data without the need of User Interface or API, also known as Headless browser. It can be used to run automated tests / snapshots and manipulate websites using Javascript.
ESB, SOA, REST, APIs and Cloud Integrations in Python
- python
- esb
- soa
- api-server
A Python feed reader library.
- rss
- rss-reader
- rss-aggregator
- rss-feed
PerkRadar — A self-hosted deals aggregator that fetches freebies, limited-time offers, and discounts from multiple sources every two hours, with source status tracking, expiration handling, and personal bookmarks.
The Sofie TV Studio Automation System, used in live TV news production by the Norwegian public service broadcaster NRK since September 2018
- sofie
- nrk
- sofie-server
- mos-protocol
Send Sir Perceval on a quest to retrieve and gather data from software repositories.
- grimoirelab
- perceval
- data-mining
- data-fetching
Playwright PHP library for browser automation: navigation, E2E tests, assertions, screenshots, and so much more!
- browser
- browser-automation
- php
- php-browser
A proactive multi-session coding-agent harness on herdr + omo: one lead, a duty loop, many lanes, a gated merge. Plus Dori mode, the messenger-facing skill.
The agentic memory & message gateway for deepseek-harness
JS script to automate setup of multiple Steam keys in sequence
- activator
- chrome
- jscript
- key
Gatling Plugin for SBT
- gatling
- sbt
- sbt-plugin
- loadtesting