LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
Repository Index
64,265 visible repositories in the index
1,993–2,016 of 7,647 · Most stars
TranslatedConcert and show ticket-grabbing script supporting multiple platforms such as 大麦网 (Damai, "Damai.cn"), 淘票票 (Taopiaopiao, "Taobao Tickets"), and 缤玩岛 (Binwandao, "Colorful Play Island")
- python
- rust
- vue
A nearly-live implementation of OpenAI's Whisper.
- dictation
- obs
- openai
- text-to-speech
Unobtrusive page transitions with jQuery.
Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.
- apache-kafka
- dataops
- react
- typescript
A Python Object-Document-Mapper for working with MongoDB
- python
- mongodb
- mongodb-orm
- mongo
ndarray: an N-dimensional array with array views, multidimensional slicing, and efficient operations
- rust
- numerics
- scientific-computing
- rust-sci
Open-source personal finance manager. Self-hosted, privacy-first.
- expense-tracker
- finance-management
- python
High performance model framework for iOS/OSX.
Optimizing inference proxy for LLMs
- agent
- agentic-ai
- agentic-workflow
- agents
eBPF Developer Tutorial: Learning eBPF Step by Step with Examples
ESP32DIV is a multi-purpose wireless offensive and defensive toolkit powered by an ESP32
Must-read papers on prompt-based tuning for pre-trained language models.
- nlp
- pre-trained-language-models
- ai
- machine-learning
TranslatedOCS online course assistant, course-grinding script, online course script, helps university students solve online course difficulties, supports online courses such as 【超星学习通 (Chaoxing Xuexitong)】【知道智慧树 (Zhidao Zhihuishu)】【职教云 (Zhijiaoyun, "Vocational Education Cloud")】【智慧职教 (Zhihui Zhijiao, "Smart Vocational Education")】【中国大学MOOC (China University MOOC)】, and can run under open-source script managers such as 脚本猫 (ScriptCat) and 油猴 (Tampermonkey).
Web simulation of Ubuntu 20.04, made using NEXT.js & tailwind CSS
- reactjs
- tailwindcss
- ubuntu2004
- personal-portfolio-website
Free Windows, Mac and Linux cleaner, scanner, and more.
- cleaner
- free
- kudu
- scanner
G-code generator for 3D printers (Prusa, Voron, Creality, etc.)
Open source APM: OpenTelemetry traces, metrics, and logs
Numbers every LLM developer should know
LPIPS metric. pip install lpips
- deep-learning
- deep-neural-networks
- perceptual
- perceptual-metric
A cross platform package to do curses-like operations, plus higher level APIs and widgets to create text UIs and ASCII art animations
A bootloader and experimentation playground for Apple Silicon
access to david ondrej's personal agent skills
🐊 Policy Controller for Kubernetes
- cncf
- opa
- kubernetes
- policy-engine