Sign in

Repository Index

47,133 repositories indexed

Tags: Automation, bots, and scraping
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

1–21 of 21 · Most stars

TranslatedAV movie management system, avmoo, javbus, javlibrary crawler, online AV movie library, AV magnet link database, Japanese Adult Video Library, Adult Video Magnet Links - Japanese Adult Video Database

Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images...

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

TranslatedBullFlow — Open-source enterprise RAG solution: knowledge base → automated marketing content → omnichannel publishing. The entire knowledge base pipeline runs on local open-source models, with no paid models needed; AI Agent creates image-text posts / images / videos, with one-click publishing to 17 platforms including Douyin, Xiaohongshu, WeChat Official Accounts, LinkedIn, and YouTube. Commercial-grade, multi-tenant, billing & admin built in. MIT

Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.

  • crawling
  • csharp
  • elixir
  • ffi

TranslatedLink to QQ: two-way connection between the AI companion in DSH and QQ — whatever it says is automatically sent to QQ, and whatever you say in QQ is automatically forwarded into DSH (via OneBot 11 HTTP; both NapCat and SnowLuma work)

Confluence Cloud to Markdown crawler with incremental updates and local link rewriting