Find secrets with Gitleaks 🔑
- security
- security-tools
- git
- golang
132,241 visible repositories in the index
1–24 of 28 · Most stars
Find secrets with Gitleaks 🔑
Translated✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field (冰霜之地, "Land of Frost"): notes on source code analysis, system design, and engineering practice
vCluster creates tenant clusters: fully isolated environments delivered as managed Kubernetes, or as the foundation for Slurm, Ray, Run:ai and inference clusters. Each gets its own API server, CRDs and RBAC, and runs on an existing cluster or standalone on bare metal. CNCF Certified Kubernetes.
Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s — in pure Python with async/await, also other languages (rust, go and ts)
An open, programmable decision layer for models and compute.
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
Cost-efficient and pluggable Infrastructure components for GenAI inference
Rule engine implementation in Golang
Self-hosted realtime soundscape analyser for birds, bats and other wildlife. Multi-model local AI inference, runs 24/7 on a Raspberry Pi.
Manages Unified Access to Generative AI Services built on Envoy Gateway
Fast, dependency-free Go package to infer binary file types based on the magic numbers header signature
Ultrafast serverless GPU inference, sandboxes, and background jobs
Router that virtually distributes inference across connected devices in the home.
Nvidia GPU exporter for prometheus using nvidia-smi binary OR using NVML
AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.
Agent Mesh
csghub-server is the backend server for CSGHub which helps user to manage datasets, modes, and also run Model Inference, Finetune and Application Spaces.
An open-source framework for verifiably private AI inference
LeaderWorkerSet & DisaggregatedSet: Kubernetes APIs for Distributed and Disaggregated AI Serving
Go With Your Own Intelligence! Use Go for hardware accelerated local inference with llama.cpp, whisper.cpp, and stable-diffusion.cpp directly integrated into your Go applications. Kronk provides a high-level API and production ready model server.
🐈 A collection of LLM inference providers and models
Gateway API Inference Extension
The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.
Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.