High-speed Large Language Model Serving for Local Deployment
Repository Index
106,102 visible repositories in the index
1–5 of 5 · Most stars
Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.
A cross-platform video structuring (video analysis) framework based on CV models & mLLM.
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
- large-language-models
- chatglm
- nlp
- chatglm2
A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.
- deepseek
- inference
- inference-engine
- llm-inference