LLM inference in C/C++
- ggml
132,241 visible repositories in the index
1–24 of 953 · Most stars
LLM inference in C/C++
The 1st Collaborative AI Design Agent Workspace. Local-first and open source. Create motion, prototypes, websites, apps, dashboards, presentations, images, and videos with your team and AI agents. Share work, exchange feedback, and iterate together in one workspace.
Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
Deepfakes Software For All
Port of OpenAI's Whisper model in C/C++
A community-supported supercharged document management system: scan, index and archive all your documents
Training-free language model modification: Remove censorship, suppress slop, reduce sycophancy, and more
A free, open source, and extensible speech-to-text application that works completely offline.
CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation
FinceptTerminal is a modern finance application offering advanced market analytics, investment research, and economic data tools, designed for interactive exploration and data-driven decision-making in a user-friendly environment.
Privacy-first AI meeting note taker for Windows, macOS and Linux. Free, open source (MIT). On-device Whisper/Parakeet transcription and speaker diarization, no meeting bot. Open-source alternative to Granola, Otter and Fireflies. https://meetily.ai
Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
The #1 AI Harness for Building Resumes, PDFs, Cover Letters & more, locally with 100+ LLMs support.
MLX: An array framework for Apple silicon
Invoke is a leading creative engine that uses image and video generation models to empower professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry-leading application interface, and serves as the foundation for multiple commercial products.
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
Distribute and run LLMs with a single file.
A game theoretic approach to explain the output of any machine learning model.
TranslatedOpen-source AI short drama and motion comic creation tool with an infinite canvas, AI agents, storyboarding, image and video generation. Self-hosted and extensible, with a canvas-based approach similar to LibTV and TapNow. Additional details from the Chinese text: Toonflow is a tool for making short dramas and motion comics: an open-source AI video creation platform that integrates script writing, intelligent storyboarding, character and scene asset management, image generation and video generation. It combines an infinite canvas, AI Agents and visual workflows, and supports local deployment, a choice of your own models, cross-platform clients, MCP and plugin extensions.
☁️ Build multimodal AI applications with cloud-native stack
Stable Diffusion with Core ML on Apple Silicon