📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.
- articles
- articles-data
- crawler
- datasets-preparation
105,102 visible repositories in the index
97–120 of 153 · Most stars
📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.
Easily download all the photos/videos from tumblr blogs. 下载指定的 Tumblr 博客中的图片,视频
A CLI for Bilibili — browse videos, users, search, and feeds from the terminal
A self-hosted price tracking application that monitors product prices from any website.
Automatically archive links to videos, images, and social media content from Google Sheets (and more).
Download song lyrics and metadata from Genius.com 🎶🎤
生成可用的代码变量 (CodeVar that return u a better variable from Chinese to English . )
WHartTest 是一款AI驱动的测试自动化平台,实现从需求到可执行测试用例的自动化生成与管理,帮助测试团队提升效率与覆盖率。 (WHartTest is an AI-driven test automation platform that automates the generation and management of executable test cases from requirements, helping testing teams improve efficiency and coverage.)
Web fetch, search, and crawl for AI agents. Built from scratch in Rust. No keys, no accounts. AGPL v3.
A free, privacy-first automatic file organizer that quietly sorts your Downloads folder from the system tray.
Generate typescript interface definitions from SQL database schema
IOT update integration for Loklak to be able to receive GENERIC data from IBM Home Automation ibmiotf
A Rust library to extract useful data from HTML documents, suitable for web scraping.
Send messages and files over Telegram from the command-line.
📚 Real-world OpenClaw automation examples from Moltbook
Reconmap is a collaboration-first security operations platform for infosec teams and MSSPs, enabling end‑to‑end engagement management, from reconnaissance through execution and reporting. With built-in command automation, output parsing, and AI‑assisted summaries, it delivers faster, more structured, and high‑quality security assessments.
A task based API for taking screenshots and scraping text from websites.
OSINT Project. Collect information from a mail. Gather. Profile. Timeline.
tweet about anonymous Wikipedia edits from particular IP address ranges
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
Extract structured data from web sites. Web sites scraping.
Drive Google Flow from Claude, Codex or a local control panel, on Mac or Windows — using your Google AI subscription credits instead of the pay-per-use video API. No browser extension.
Open-source design agent: on-brand stills, decks, diagrams, charts and motion graphics from a chat thread, built on Deep Agents.
Cloudlog is a web-based amateur radio logging application built with PHP and MySQL. It supports a wide range of station logging activities, from HF to microwave, and integrates with companion tools for CAT control and automation.