The job search that runs on your machine. AI job application framework built on Claude Code: evaluate postings, tailor CVs, write cover letters, prep interviews. Fork it and own it.
- ai
- ai-agents
- career
- claude-code
Repository Index
82,088 visible repositories in the index
1–24 of 27 · Most stars
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
- machine-learning
- ai
- ml
- mlflow
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Theano was a Python library that allows you to define, optimize, and evaluate mathematical expressions involving multi-dimensional arrays efficiently. It is being continued as PyTensor: www.github.com/pymc-devs/pytensor
Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
AI agent to evaluate and score resumes.
Train and evaluate embeddings for similarity search with PyTorch. Includes contrastive losses, hard example mining, samplers, and retrieval metrics.
- metric-learning
- deep-learning
- computer-vision
- machine-learning
Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.
- ai
- chain-of-thought
- collaboration
- dataset-generation
The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.
Most popular metrics used to evaluate object detection algorithms.
- metrics
- object-detection
- average-precision
- mean-average-precision
Code, Build and Evaluate agents - excellent Model and Skills/MCP/ACP/A2A Support
A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)
mean Average Precision - This code evaluates the performance of your neural net for object recognition.
- machine-learning
- pascal-voc
- average-precision
- ground-truth
Code to pretrain, fine-tune, and evaluate DreamZero and run sim & real-world evals
🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
- evaluation
- machine-learning
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
- machine-learning
- experimentation
- llm-prompting
- llm-test
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
This project aims to compare and evaluate the telemetry of various EDR products.
[CVPR2024 Highlight] VBench - We Evaluate Video Generation
- aigc
- evaluation-kit
- gen-ai
- stable-diffusion
Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
A benchmark built to evaluate and improve agent capabilities for supporting legal work.
The living ecosystem where AI agents complete tasks through workflow loops, improve through iterative execution, are evaluated by mentor agents or humans in the loop, and turn completed work into reusable work experience and data to improve future agents.
- agent-experience
- agent-learning
- agent-traces
- ai-agents
Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.
- agentic-ai
- evaluation
- agent-evaluation
- agent-security
Evaluate OMR sheets fast and accurately using a scanner 🖨 or your phone 🤳.
- opencv
- image-processing
- omr
- omr-sheet