Trending repositories

1.ggml-org / llama.cpp

LLM inference in C/C++

• ggml

2.microsoft / BitNet

Official inference framework for 1-bit LLMs

3.mozilla-ai / llamafile

Distribute and run LLMs with a single file.

• cross-platform
• gguf
• llama-cpp
• local-ai
• local-inference
• local-llm
• +3 more

4.nomic-ai / gpt4all

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

• llm-inference
• ai-chat

5.cyberman54 / ESP32-Paxcounter

Wifi & BLE driven passenger flow metering with cheap ESP32 boards

• wifi
• ttgo
• lopy
• heltec
• ttn
• lorawan
• +14 more

6.uxlfoundation / oneDNN

Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.

• onednn
• oneapi
• performance
• cpp
• x64
• aarch64
• +14 more

7.VectorDB-NTU / RaBitQ-Library

Official library for RaBitQ vector quantization and approximate nearest-neighbor search, in C++ and Python.

• nearest-neighbor-search
• quantization
• vector-database
• vector-search
• ann
• approximate-nearest-neighbor-search
• +7 more

8.google / minja

A minimalistic C++ Jinja templating engine for LLM chat templates

9.NGT-labs / NGT

Nearest Neighbor Search with Neighborhood Graph and Tree for High-dimensional Data

• approximate-nearest-neighbor-search
• k-nearest-neighbors
• knn-search
• nearest-neighbors
• nearest-neighbor-search
• vector-database
• +1 more

10.unum-cloud / UStore

Multi-Modal Database replacing MongoDB, Neo4J, and Elastic with 1 faster ACID solution, with NetworkX and Pandas interfaces, and bindings for C 99, C++ 17, Python 3, Java, GoLang 🗄️

• acid
• database
• key-value-store
• document-database
• graph-database
• json
• +14 more

11.Restream / reindexer

Embeddable, in-memory, document-oriented database with a high-level Query builder interface.

• database
• embedable
• go
• in-memory
• cpp
• cpp-library
• +7 more