Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?
Repository Index
111,821 visible repositories in the index
1–5 of 5 · Most stars
Demo of running NNs across different frameworks
A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.
Benchmarks for Low Latency (Streaming) solutions including Apache Storm, Apache Spark, Apache Flink, ...
- benchmarks
- low-latency
- streaming
a nose plugin for finding and running IPython notebooks as nose tests