Repository Index

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

• llm-inference
• ai-chat

Official inference framework for 1-bit LLMs

Distribute and run LLMs with a single file.

• cross-platform
• gguf
• llama-cpp
• local-ai

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

• mnn
• convolution
• vulkan
• embedded-devices

llama.cpp fork that abliterates at inference

• abliteration
• ai
• inference
• llama-cpp