Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
- agentneo
- agents
- ai-performance-optimization
- llm-testing
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.
- ai
- fairness-ai
- fairness
- fairness-testing
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
The official Python SDK for Sentry.io
- sentry
- python
- sentry-python
- crash-reporting
(IROS 2020, ECCVW 2020) Official Python Implementation for "3D Multi-Object Tracking: A Baseline and New Evaluation Metrics"
Common financial risk and performance metrics. Used by zipline and pyfolio.
Evaluation code for various unsupervised automated metrics for Natural Language Generation.
Hunter is a flexible code tracing toolkit.
Maze Applied Reinforcement Learning Framework
OpenType vertical metrics reporting and font line spacing adjustment tool
- font
- metrics-reported
- vertical-metrics
- upm
Distributed tracing instrumentation for asyncio with zipkin
CLI utility and Python module for analyzing log files and other data.
Dreamento (DReam ENgenieering TOolbox): a Python-based software for dream engineering while monitoring/analyzing real-time EEG data.
- automatic-sleep-analysis
- dream
- eeg-analysis
- lucid-dreaming
Produce watertight polygonal vector maps by tracing raster images
Async MQTT client for CPython and MicroPython with asyncio support.
Infer Types by Python Tracing
Asyncronous Sentry.io micro client for micropython