Tile-Based Runtime for Ultra-Low-Latency LLM Inference
Repository Index
109,091 visible repositories in the index
289–312 of 697 · Most stars
基于PaddleOCR重构,并且脱离PaddlePaddle深度学习训练框架的轻量级OCR,推理速度超快 —— A lightweight OCR system based on PaddleOCR, decoupled from the PaddlePaddle deep learning training framework, with ultra-fast inference speed.
- document-layout-analysis
- license-plate-recognition
- ocr
- onnx-models
TensorFlow template application for deep learning
- tensorflow
- tfrecords
- libsvm
- csv
A Keras port of Single Shot MultiBox Detector
- ssd
- keras
- ssd-model
- object-detection
GPT-SoVITS ONNX Inference Engine & Model Converter
- gpt-sovits
- tts
- text-to-speech
- vits
⚠️ Experimentelle Skill-Sammlung für deutsches Recht (Arbeits-, Gesellschafts-, Insolvenz-, Datenschutz-, Prozessrecht u.a.) – inzwischen verbessert und im Alltag getestet, aber weiterhin Experiment. Bitte selber ausprobieren, Issues/PRs willkommen! Keine Rechtsberatung. Mandatsgeheimnis (§§ 203/204 StGB, § 43e BRAO), DSGVO, US-Transfer, KI-VO & Co
- anthropic
- bgh
- claude-skills
- dsgvo
OnionSearch is a script that scrapes urls on different .onion search engines.
- information-gathering
- osint
- osint-tools
- open-source-intelligence
An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
Set of methods to ensemble boxes from different object detection models, including implementation of "Weighted boxes fusion (WBF)" method.
- ensemble-prediction
- object-detection
- boxes
A DNS reconnaissance tool for locating non-contiguous IP space.
- dns
- zone-transfers
- reconnaissance
- discovered-domains
TurboQuant: Near-optimal KV cache quantization for LLM inference (3-bit keys, 2-bit values) with Triton kernels + vLLM integration
High Performance Serving Runtime For Interactive Super Intelligence System
Vitis AI is Xilinx’s development stack for AI inference on Xilinx hardware platforms, including both edge devices and Alveo cards.
Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
Reference implementations of MLPerf® training benchmarks
Caption-Anything is a versatile tool combining image segmentation, visual captioning, and ChatGPT, generating tailored captions with diverse controls for user preferences. https://huggingface.co/spaces/TencentARC/Caption-Anything https://huggingface.co/spaces/VIPLab/Caption-Anything
- chatgpt
- controllable-generation
- segment-anything
- controllable-image-captioning
Sublime Text plugin for EditorConfig - Helps developers maintain consistent coding styles between different editors
- sublime-package
- sublime-text-plugin
- sublime-text
- editorconfig
Clean, modern, Python 3.6+ code generator & library for Protobuf 3 and async gRPC
- python-3
- protocol-buffer-compiler
- asyncio
- grpc
A standard format for offline reinforcement learning datasets, with popular reference datasets and related utilities
- datasets
- gymnasium
- offline-rl
- reinforcement-learning
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
- agents
- calibration
- classification
- decision-making
Pytorch implementation of various Knowledge Distillation (KD) methods.
- kd-methods
- knowledge-transfer
- knowledge-distillation
- kd
An email spoofing testing tool that aims to bypass SPF/DKIM/DMARC and forge DKIM signatures.🍻
- spoofing-emails
- spf
- dkim
- dmarc
Inference Microsoft Florence2 VLM
Official PyTorch inference for Breeze TTS 2