Add a real-time analytics node to your operational database. Spice is a portable, accelerated SQL query, search, and LLM-inference engine in Rust for data-grounded AI apps and agents.
- artificial-intelligence
- developers
- machine-learning
- data
Repository Index
79,841 visible repositories in the index
601–624 of 1,242 · Most stars
Improved file parsing for LLM’s
- document-structure
- table-detection
- document-parser
- layout-parsing
Let ChatGPT teach your own chatbot in hours with a single GPU!
Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
- large-language-models
- video-language-pretraining
- vision-language-pretraining
- blip2
QuantMind is an open source agent-native knowledge extraction and retrieval framework for quantitative finance.
- quantitative-finance
- quantitative-research
- data
- knowledge
Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
- bert
- pre-training
- fine-tuning
- gpt
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
- ai
- containers
- cuda
- hip
DeepTeam is a framework to red team LLMs and AI agents.
- llm-guardrails
- llm-red-teaming
- llm-safety
- python
Community maintained hardware plugin for vLLM on Huawei Ascend
LLMRouter: An Open-Source Library for LLM Routing
Same agent Smaller bill. The tools and infrastructure to get more work from your AI. Fewer tokens. Less compute. Lower cost.
- observability
- llmops
- ai-observability
- openai
OpenGame: Open Agentic Coding for Games
Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
AI Search & RAG Without Moving Your Data. Get instant answers from your company's knowledge across 100+ apps while keeping data secure. Deploy in minutes, not months.
- search
- search-engine
- federated-query
- federated-search
An open-source visual programming environment for battle-testing prompts to LLMs.
- ai
- evaluation
- large-language-models
- llmops
Toolkit for creating, sharing and using natural language prompts.
Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集
A framework for prompt tuning using Intent-based Prompt Calibration
- prompt-engineering
- prompt-tuning
- synthetic-dataset-generation
Open-source desktop AI agent for tools, files, knowledge, workflows, and real deliverables.
.NET library for the OpenAI service API by Betalgo Ranul
- csharp
- dall-e
- dotnet
- openai
Lucebox inference engine for heterogeneous hardware & consumer GPUs
A Model Context Protocol server for converting almost anything to Markdown
High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.