Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Repository Index
47,133 repositories indexed
1–10 of 10 · Most stars
Supercharge Your LLM Application Evaluations 🚀
- llm
- llmops
- evaluation
Replace 'hub' with 'ingest' in any GitHub URL to get a prompt-friendly extract of a codebase
- ai
- code
- ingestion
- developer-tool
structured outputs for llms
- openai
- python
- pydantic-v2
- openai-functions
Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
- agents
- calibration
- classification
- decision-making
Speedrun for pretraining without backpropagation
Tamper-evident tracing, policy gates and cross-checks for AI agents: see what the agent did, and why.
- agent-security
- ai-agents
- audit-log
- claude-code
Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.
- calibration
- cuda
- cuda-graphs
- decision-making
DecisionPivot: a diagnostic benchmark for decision models in LLM systems. Contrast pairs that differ in one decisive detail, generators with independent solvers, scorer and runners.
- benchmark
- calibration
- decision-making
- evaluation