Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
Repository Index
71,235 visible repositories in the index
73–96 of 354 · Most stars
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- web-scraping
- text-extraction
- nlp
- html2text
Officially maintained, supported by PaddlePaddle, including CV, NLP, Speech, Rec, TS, big models and so on.
- paddlepaddle
- deep-learning
- neural-network
- computer-vision
Python Stream Processing
- kafka-streams
- kafka
- python
- asyncio
Python library for processing Chinese text
Image processing in Python
- image-processing
- python
- computer-vision
PDF craft can convert PDF files into various other formats. This project will focus on processing PDF files of scanned books.
FunASR-powered video transcription, subtitle generation, and LLM-assisted clipping tool with a local Gradio UI.
- speech-recognition
- video-subtitles
- subtitles-generator
- speech-to-text
Claude Skill: Multi-source content processor for NotebookLM. Supports WeChat articles, web pages, YouTube, PDF, Markdown, search queries → Podcast/PPT/MindMap/Quiz etc.
- automation
- claude
- mcp
- notebooklm
This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)
Remove visible and invisible AI watermarks from images and video, and AI provenance metadata from images, video, and audio. Python library, CLI, and agent skill for SynthID, C2PA, EXIF, IPTC, XMP, and common generative-AI marks. By Victor Kuznetsov.
- cli
- image-processing
- metadata
- watermark-removal
Python Audio Analysis Library: Feature Extraction, Classification, Segmentation and Applications
- audio
- machine-learning
- signal-processing
- audio-data
A node-based image processing GUI aimed at making chaining image processing tasks easy and customizable. Born as an AI upscaling application, chaiNNer has grown into an extremely flexible and powerful programmatic image processing application.
🌊 Online machine learning in Python
- incremental-learning
- machine-learning
- python
- online-learning
Translate darknet to tensorflow. Load trained weights, retrain/fine-tune using tensorflow, export constant graph def to mobile devices
- tensorflow
- graph
- darknet
- deep-learning
👷 Build images with images
- mosaic-images
- image-processing
- python
- tiling
🚀 Efficient implementations for emerging model architectures
- large-language-models
- machine-learning-systems
- natural-language-processing
- sequence-modeling
A Unified Toolkit for Deep Learning Based Document Image Analysis
- layout-analysis
- deep-learning
- object-detection
- ocr
😎 Finding duplicate images made easy!
- image-deduplication
- neural-network
- hashing
- e-commerce
A large-scale 7B pretraining language model developed by BaiChuan-Inc.
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
- point-cloud
- classification
- segmentation
- neural-network
:movie_camera: Python and OpenCV-based scene cut/transition detection program & library.
Local video editor for coding agents: 42 FFmpeg tools with a machine-readable contract and an MCP server, for Claude Code, Cursor and Codex. Cut, captions, reframe, loudness, platform exports. No cloud, no API keys.
🏝️ OASIS: Open Agent Social Interaction Simulations with One Million Agents.
- agent-based-framework
- agent-based-simulation
- large-language-models
- large-scale