Streaming-first load balancer for AI inference gateways
Repository Index
111,085 visible repositories in the index
793–816 of 869 · Most stars
Neovim feed reader, rss, atom and jsonfeed, all in lua
Deepinfer inspired implemetation on SM80 Ampere architecture. Deepest respect for DeepSeek opensource this work!
ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.
PROMETHEVS: run the full DeepSeek-V4.1-Flash-1017 (510 GB) on a gaming PC with 64 GB RAM and a 12 GB GPU. PROMETHEVS engine (compress-then-correct), OpenAI-compatible local server, report and logs.
Translated🐋 Complete guide in Russian: how to install and run DeepSeek locally (V4, R1) on PC, Mac and server — Ollama, llama.cpp, LM Studio, vLLM, Open WebUI, API, RAG, agents, fine-tuning, best tips and tricks
- ai-agents
- deepseek
- deepseek-r1
- deepseek-v4
A collection of awesome papers, articles and various resources on credit and credit risk modeling
- credit-scoring
- credit-modeling
- financial-machine-learning
- sample-selection
inference and machine learning in clojure
Ruby FHIR Client
- fhir
- fhir-client
Feel how fast a local LLM runs before you buy the hardware
This repository contains notebooks that show the usage of TensorFlow Lite for quantizing deep neural networks.
- tensorflow-2
- tensorflow-lite
- on-device-ml
- model-quantization
Production compatibility gateway bridge & observability platform connecting Claude Code CLI with Google Antigravity & Gemini inference models via Anthropic Messages API
PocketStrike is a privacy-first mobile AI workstation. It combines zero-cloud native on-device GGUF inference (ARM NEON accelerated) │ with frontier cloud LLMs, multi-step ReAct agent tools, Model Context Protocol (MCP) servers, self-evolving cross-session memory, and FLUX neural image │ generation.
Probabilistic programming framework that facilitates objective model selection for time-varying parameter models.
- time-series-analysis
- model-selection
- bayesian-inference
- anomaly-detection
Source code of Local Code, a private AI agent for Mac, iPad and iPhone. Runs DeepSeek 4.1 on device, with Python, Node.js and a shell built into the app.
A Long-Horizon Benchmark for Self-Improving Inference Systems
feedparser gem - (universal) web feed parser and normalizer (XML w/ Atom or RSS, JSON Feed, HTML w/ Microformats e.g. h-entry/h-feed or Feed.HTML, Feed.TXT w/ YAML, JSON or INI & Markdown, etc.)
- feed
- atom
- rss
- feedparser
Official implementation of "AReA: Adaptive Receptive-Field Attention for Efficient High-Resolution Diffusion Transformers"
- diffusion-models
- efficient-inference
- high-resolution
- image-generation
Bringing thousands of learners together to unpack DeepInfer through peer-reviewed explanations, documentation, and hands-on examples.
Easily import, modify, and export icons (for Xcode and more)
Auto Nix GC Root Retention
Aegis SkinFees: console-grade workspace for CS2 fee math — venue models, FX conversion and net-profit estimates fully on device.
InferPy: Deep Probabilistic Modeling with Tensorflow Made Easy
- probabilistic-programming
- neural-network
- tensorflow
- keras-tensorflow
⚡ Open-source software for deep learning-based digital pathology
- deep-learning
- machine-learning
- digital-pathology
- computational-pathology