A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
- speculative-decoding
132,241 visible repositories in the index
145–168 of 264 · Most stars
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
Non-Intrusive Load Monitoring Toolkit (nilmtk)
3D LiDAR SLAM for pointcloud-map authoring, benchmarking, and Autoware-compatible map workflows.
CUP, common useful python-lib. (Currently, Most popular python lib in baidu). Python 开发底层库, 涵盖util、service(threadpool/generator/executor/cache等等)、logging、monitoring、增强型配置 等等库支持
A distilled Segment Anything (SAM) model capable of running real-time with NVIDIA TensorRT
Using network observability to operate and design healthier networks
本地监控 + AI 视觉 — LAN-based smartphone-powered AI monitoring framework with structured event output for data acquisition and analysis.
Modern web-based UPS monitoring system with real-time data visualization, alerts, and comprehensive reporting. Docker-ready with multi-architecture support.
:satellite: A Mac menubar app that notifies you whenever SSH, VNC, sudo, or other auth events occur.
open source agent engineering platform: traces, evals, and metrics to debug and improve your AI agents. Integrates with LangGraph, CrewAI, Claude Agent SDK, and more.
Rich-powered CLI that breaks each HTTP request into DNS, connect, TLS, wait, and transfer phases with waterfall timelines, compact summaries, or metrics-only output.
[ICCV 2023] StreamPETR: Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detection
End-to-end AI short-video production pipeline. FastAPI orchestration + Spring Boot gateway with multi-model failover, circuit breaker, metering, and full-stack observability. AI quality gating: prompt anchoring, CLIP consistency, AV sync auto-rescue.
Krawl is a customizable, lightweight, cloud-native web deception server and anti-crawler that creates fake web applications with low-hanging vulnerabilities using realistic, randomly generated decoy data and AI-generated HTML templates.
A lightweight, open-source network monitor for Windows that displays live upload/download speeds directly on the Taskbar with a native look and feel.
[DEPRECATED] Repo for exploring multi-task learning approaches to learning sentence representations
Automatically monitor the evolving performance of Flask/Python web services.
A pytorch implementation for paper 'Exploring Simple Siamese Representation Learning'
The tool to help you discover resources in the cloud environment
Scorecard Development in python, 评分卡
Turn hand-drawn story illustrations into 35–45 second line-reveal and gradual-coloring videos with HyperFrames.
Luminaire is a python package that provides ML driven solutions for monitoring time series data.
Flexible command line tool to create graphs from CSV data
A minimal Python package for storing and retrieving text using chunking, embeddings, and vector search.