Simple web scraping for R
Repository Index
47,133 repositories indexed
25–48 of 63 · Most stars
:rocket: An open source alternative to searx which provides a modern-looking :sparkles:, lightning-fast :zap:, privacy respecting :disguised_face:, secure :lock: meta search engine
- meta-search-engine
- rust
- search-engine
- fast
Visually build a full featured chat bot for Telegram, Facebook Messenger, Whatsapp and Slack with Node-RED. Almost no coding skills required.
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
- xquery
- xml
- html
- json
htmlquery is golang XPath package for HTML query.
- html
- xpath
- html-parser
- golang
Functional HTML scraping and rewriting with CSS in OCaml
🐘 A PHP client for interacting with Gotenberg.
A Oembed consumer library, that gives you information about urls. It helps you replace urls to youtube or vimeo for example, with their html embed code. It has advanced features like offline support, responsive embeds and caching support.
Scrape any website, article or RSS/Atom Feed with ease!
- scrape
- elixir
- readability
- rss
An Elixir library for parsing and extracting data from HTML and XML with CSS or XPath selectors.
Configuration as Code, use YAML to write automated workflows that run on Deno, with any Deno modules, Typescript/Javascript codes
Readability is Elixir library for extracting and curating articles.
- readability
- webpage
- parser
- elixir
Browser automation solution for Kubernetes and Openshift supporting Selenium, Playwright, Puppeteer and Cypress
- selenium
- selenium-webdriver
- kubernetes
- selenium-grid
A declarative struct-tag-based HTML unmarshaling or scraping package for Go built on top of the goquery library
- golang
- unmarshall
- goquery
- selectors
Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.
- ai-agents
- browser-automation
- data-extraction
- firecrawl
Extract URLs to stylesheets, scripts, links, images or HTML imports from HTML
Collection of tools and scripts useful to automate microscopy workflows in ZEN Blue using Python and Open Application Development tools and AI tools.
- python
- microscopy
- scripting
- automation
A robust web archive analytics toolkit
- python
- web
- warc
- bigdata
XPath/XQuery 3.1 interpreter for Pascal with compatibility modes for XPath 2.0/XQuery 1.0/3.0, custom and JSONiq extensions, pattern matching, XML/HTML/JSON parsers and classes for HTTP/S requests
- xpath
- xquery
- pascal
- html
Control your Android phone with natural language. No computer required. Powered by Midscene, with Skills and a Codex plugin.
Visual Integration Designer for Apache Camel
- camel
- camel-k
- apache-camel
- integration
NEXA Tools Pro — a multi-tool Chrome extension (Manifest V3) with social automation, 600% audio boost, element zapper, screenshots, screen recording, QR tools, and more — built with vanilla HTML, CSS, and JavaScript.
- automation
- browser-extension
- chrome-extension
- css
Pagser is a simple, extensible, configurable parse and deserialize html page to struct based on goquery and struct tags for golang crawler
- go
- golang
- goquery
- colly
A cross-platform IRC framework for Qt