Sign in

Repository Index

47,133 repositories indexed

Filters

Filters

Clear all filters

1–22 of 22 · Most stars

7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.

AWS Service registry for resilient mid-tier load balancing and failover.

A registry for resilient mid-tier load balancing and failover.

  • discovery
  • golang
  • eureka

FlexyPool adds metrics and failover strategies to a given Connection Pool, allowing it to resize on demand.

  • connection-pool
  • java
  • histogram
  • dbcp

🚨 Design workflows of slog handlers: pipeline, middleware, fanout, routing, failover, load balancing...

  • go
  • golang
  • slog
  • handler

TranslatedConnect all the model quotas you can get for free into the same DSH pool: automatic multi-account fault tolerance for WorkBuddy, QR-code login for 13 providers, aggregation of free quotas from 76 providers, a usage dashboard, model routing, a local OpenAI gateway, and automated points collection.

In-memory key-value server in Rust that speaks RESP, so redis-cli and Redis clients connect. Locks, rate limits, job queues and a change feed are single commands; Raft-based failover. Clients for Rust, .NET, Go, Java, Python and Node.js.

TranslatedA circuit-breaker and reconnector for dsh, aimed at network/large model API fluctuations during long tasks, preventing tasks from stalling; it switches between different channels and models to keep completing the task. Supports web and CLI.

Manage and use multiple Ollama instances with automatic offline detection/failover and model availability tracking