Repository Index

TranslatedSelf-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.

• tiktok
• douyin
• scraper
• crawler

Collection of scripts to aggregate image data for the purposes of training an NSFW Image Classifier

• nsfw-classifier
• nsfw
• deep-learning
• content-moderation

Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.

• python
• machine-learning
• natural-language-processing
• web-mining

历史学习项目：Spark 电影推荐、爬虫、Web 与后台。新版持续开发见 cinematch-recommender。

• spark-mllib
• spark-streaming
• ssm-maven
• scrapy

媒体服务器演员头像仓库

• emby
• jellyfin
• plex
• avatar

Vision utilities for web interaction agents 👀

• ocr
• playwright
• selenium
• webscraping

A dataset of millions of news articles scraped from a curated list of data sources.

• fakenews
• dataset
• database
• corpus

Video game review datasets scraped from the Steam website (http://store.steampowered.com/). Data includes review text, number of hours that the reviewer played the game, number of friends, groups, etc.