LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Repository Index
47,133 repositories indexed
1–10 of 10 · Most stars
DataLoader is a generic utility to be used as part of your application's data fetching layer to provide a consistent API over various backends and reduce requests to those backends via batching and caching.
A query batching executor for the graphql gem
- graphql
- promise
- batch
:zap: Powerful tool for avoiding N+1 DB or HTTP queries
- n-plus-1
- batching
- ruby
- gem
High-performance immutable data structures for modern JavaScript and TypeScript applications. Functional interfaces, deep/composite operations API, mixed mutability API, TypeScript definitions, ES2015 module exports.
- immutable
- typescript-definitions
- es2015-modules
- data-structures
ReactRelayNetworkLayer with middlewares and query batching for Relay Classic.
- relay
- relay-network-layer
- graphql-client
- batch-request
Efficient, asynchronous batching and caching in clustered environments, port of Facebook DataLoader
- facebook-dataloader
- vertx-dataloader
- graphql
- java-8
InsNet Runs Instance-dependent Neural Networks with Padding-free Dynamic Batching.
- deep-learning-library
- dynamic-batching
- nlp
Simple C++ InfluxDB client via MS C++ REST SDK + RxCpp for batching (Windows/OSX/Linux) + a C wrapper
- influxdb
- rxcpp
- batching
- client
Message batching library for Elixir applications