Sign in

Repository Index

61,275 visible repositories in the index

Tags: All Tags
Tags

A repository shows when it has any selected Tag.

Filters

Filters

Clear all filters

1,225–1,248 of 7,299 · Most stars

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

  • edge-ai
  • on-device-ai
  • on-device-llm

open source、high performance、industrial rtsp streaming server,a lot of optimization on streaming relay,KeyFrame cache,RESTful,and web management,also EasyDarwin support distributed load balancing,a simple streaming media cloud platform architecture.

  • easydarwin
  • rtsp-server
  • flv
  • rtsp

An audio server, programming language, and IDE for sound synthesis and algorithmic composition.

  • supercollider
  • sclang
  • electronic-music
  • scsynth

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

  • localllm

Haven is for people who need a way to protect their personal spaces and possessions without compromising their own privacy, through an Android app and on-device sensors

  • sensor
  • device-sensors
  • monitoring-service
  • prototype-android-application

💡 Looking for inspiration for your next open source project? Or perhaps you've got a brilliant idea you can't wait to share with others? Open Source Ideas is a community built specifically for this! 👋

  • open-source-community
  • ideas
  • open-source-initiative
  • community

[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.