Sign in

Repository Index

132,241 visible repositories in the index

Tags: All Tags
Tags

A repository shows when it has any selected Tag.

Filters

Filters

Clear all filters

25–48 of 748 · Most stars

TranslatedThis project aims to share the technical principles of large models and practical experience (large model engineering, large model application deployment).

DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

  • apple-silicon
  • inference-server
  • llm
  • macos

The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

  • mnn
  • convolution
  • vulkan
  • embedded-devices