Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
Repository Index
66,263 visible repositories in the index
217–240 of 417 · Most stars
Simple, lightweight and faster response (JSON, JSONP, XML, YAML, HTML, File) rendering package for Go
- renderer
- render
- gorender
- goresponse
This is quick session for net/http in golang. This package is perhaps the best implementation of the session mechanism, at least it tries to become one.
- go
- golang
- session
A Lightweight VPN Built on top of IPFS + Libp2p for Truly Distributed Networks (fork)
Apache Spark Connect Client for Golang
Convert string to camel case, snake case, kebab case / slugify, custom delimiter, pad string, tease string and many other functionalities with help of by Stringy package.
- stringygolang
- golang
- stringy
- stringhelper
Monitor and profiler powered by eBPF to monitor network traffic, and diagnose CPU and network performance.
- skywalking
- observability
- apm
- service-mesh
Pocache is a minimal cache package which focuses on a preemptive optimistic caching strategy
This package provides json web token (jwt) middleware for goLang http servers
Pactus blockchain
A binary stream packer and unpacker
- unpacker
- packer
An easy to use menu structure for cli applications that prompts users to make choices.
- awesome-go
- cli
- menu
- golang-package
k6 extension to load test Apache Kafka with support for various serialization formats, SASL, TLS, compression, Schema Registry client and beyond
Merge multiple pcap files together, gracefully.
- pcap
- merge
- tcpdump-capture
- packet-processing
✨ Golang Client Library for Atlassian Cloud.
- jira
- confluence
- jira-service-management
- api-client
Deploy static HTML/JS/CSS apps to Cloud Foundry
- v2b
Drop-in replacement for the standard library errors package and github.com/pkg/errors
- error
- errors
- stacktrace
Go package for sharding databases ( Supports every ORM or raw SQL )
- go
- golang
- golang-library
- database-sharding
timeutil - useful extensions (Timedelta, Strftime, ...) to the golang's time package
The jsonrpc package helps implement of JSON-RPC 2.0
💾🧹 A lightweight, software cache cleanup tool for Windows & Linux.
- cleaner
- go
- golang
- cli-tool
a package for decode form's values into struct in Go
- decode
- form
- decoding
- decode-form
Go Dependency Injection Framework
- dependency-injection
- flamingo-module
- golang
- golang-package
GoJava - Java bindings for Go packages