Repository Index

Distribute and run LLMs with a single file.

• cross-platform
• gguf
• llama-cpp
• local-ai

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

• mnn
• convolution
• vulkan
• embedded-devices

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

• inference
• deep-learning
• openvino
• ai

Production ready toolkit to run AI locally

• ios
• kotlin
• llm
• swift

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

• deep-learning
• pytorch
• ai
• mlops

Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.

• onednn
• oneapi
• performance
• cpp