Distributed AI Model Training and LLM Fine-Tuning on Kubernetes
Repository Index
111,821 visible repositories in the index
457–480 of 1,106 · Most stars
Fast State-of-the-Art Static Embeddings
- embeddings
- machine-learning
- model2vec
- nlp
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
- ai-gateway
- observability
- simulation
- ai-agents
The knowledge compiler. Raw sources in, interlinked wiki out. Inspired by Karpathy's LLM Wiki pattern.
Agentic RL Training at Scale
Extract structured data from PDF invoices
- python
- data-mining
Lumina-T2X is a unified framework for Text to Any Modality Generation
- aigc
- transformer
- diffusion-models
- diffusion
Local-first AI token usage & cost tracker for 31 coding tools incl. Claude Code, Codex, Cursor, Gemini & DeepSeek Harness—with native apps. Never reads prompts.
- claude-code
- cli
- codex-cli
- cost-tracker
Transform Web Content into LLM-Ready Data
- crawl4ai
- crawler
- crawling-python
- html2markdown
Pre-trained word vectors of 30+ languages
- vector
- word2vec
- language
- fasttext
Instant, controllable, local pre-trained AI models in Rust
🌍 WorldGen - Generate Any 3D Scene in Seconds
- 3d-generation
- 3d-reconstruction
- generative-ai
- scene-generation
Meditron is a suite of open-source medical Large Language Models (LLMs).
ggml speech-to-text inference for 16+ model families
- asr
- ggml
- gguf
- speech-to-text
A desktop app to prototype agent ideas, inspect every harness step, replay failures, and evaluate performance, all in one place. Local-first, cloud-ready for managed agents.
- agent
- deer-flow
- develop
- electrobun
Inference Llama 2 in one file of pure 🔥
Simulate Before Reality.
AI-native agent harness for coding workflows by python: multi-model LLM orchestration, stateful sessions, tool governance, traceable delivery, and provider routing for GPT, Claude, DeepSeek, Qwen, Kimi, GLM, and MiniMax.
Extract structured data and insights from documents using LLMs and decision models
- ai
- data-extraction
- document-intelligence
- generative-ai
Reverse engineer any repo into it's original prompt
An on-premises, OCR-free unstructured data extraction, markdown conversion and benchmarking toolkit. (https://idp-leaderboard.org/)
- document
- document-analysis
- extraction
- llms
An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
- natural-language-processing
- prompt-tuning
- pretrained-language-model
- p-tuning
AICI: Prompts as (Wasm) Programs
PageLM is a community driven version of NotebookLM & a education platform that transforms study materials into interactive resources like quizzes, flashcards, notes, and podcasts.