Astrid is a portable, capability-secure operating system for composable software.
Repository Index
65,264 visible repositories in the index
25–48 of 105 · Most stars
The programming language for agents
- llm
- boundaryml
- guardrails
- structured-data
⚙️🦀 Build modular and scalable LLM Applications in Rust
World's first open-source enterprise world model.
- agent-memory
- knowledge-base
- knowledge-graph
- llm
A Datacenter Scale Distributed Inference Serving Framework
- diffusion
- disaggregated-serving
- kubernetes
- llm-inference
Fast, flexible LLM inference
- llm
- rust
- uqff
A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.
AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models
- ai-workflows
- artifical-intelligense
- claude-3-7-sonnet
- command-line
Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
- machine-learning
- computer-vision
- data-format
- deep-learning
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
- gateway
- generative-ai
- llm-inference
- llms
An embeddable, portable, branchable virtual machine to safely run Agents locally.
- containers
- crun
- libkrun
- microvm
Postgres with GPUs for ML/AI apps.
- ml
- machine-learning
- ai
- ann
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
- llama
- llamacpp
- llm-inference
- ollama-api
A high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.
A blazing fast inference solution for text embeddings models
agent runtime security - zero trust, zero setup, zero latency agent sandboxing
Tiny, fast, Linux-compatible sandboxes. Powered by WebAssembly.
RuVector provides High Performance, Real-Time decisions and agent memory , Self-Learning Ai, Vector GNN DB built in Rust.
- ai
- ai-ocr
- gnn
- graph
Metal driver for NVIDIA GeForce cards on macOS Sequoia
Manage multiple Claude Code, OpenCode agents from either TUI or Web for easy access on mobile. Also supports Mistral Vibe, Codex CLI, Gemini CLI, Pi.dev, Copilot CLI, Factory Droid Coding.
Vision infrastructure to turn complex documents into LLM-ready data
Language model tokenization at GB/s
Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.
- agents
- ai
- decentralized
- distributed
Hold a key, speak, release — AI-polished text appears at your cursor in any app. Open-source voice input for macOS & Windows. (按住快捷键说话，松开即得润色后的文字)
- ai-prompt
- asr
- dictation
- macos