The LLM Evaluation Framework
- evaluation-metrics
- evaluation-framework
- llm-evaluation
- llm-evaluation-framework
142,273 visible repositories in the index
217–240 of 8,991 · Most stars
The LLM Evaluation Framework
Devika is the first open-source implementation of an Agentic Software Engineer. Initially started as an open-source alternative to Devin.
Bring portraits to life!
ARIS ⚔️ (Auto-Research-In-Sleep) — Lightweight Markdown-only skills for autonomous ML research: cross-model review loops, idea discovery, and experiment automation. No framework, no lock-in — works with Claude Code, Codex, OpenClaw, or any LLM agent.
Turns Data and AI algorithms into production-ready web applications in no time.
A TTS model capable of generating ultra-realistic dialogue in one pass.
TranslatedNetflix-level subtitle cutting, translation, alignment, and even dubbing - one-click fully automated AI video subtitle team
TranslatedAbu Quantitative Trading System (stocks, options, futures, Bitcoin, machine learning) An open-source quantitative trading and quantitative investment architecture based on Python
Let Claude Code, Codex or Cursor use your real Chrome, logged in as you. One prompt to set up. Open source, MIT.
SkillOpt is a text-space optimizer that trains reusable natural-language skills for frozen LLM agents through trajectory-driven edits, validation-gated updates, and deployable best_skill.md artifacts.
Daemon to ban hosts that cause multiple authentication errors
The interactive graphing library for Python :sparkles:
TranslatedChinese LLaMA & Alpaca LLMs + local CPU/GPU training and deployment
Wan: Open and Advanced Large-Scale Video Generative Models
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
SQL databases in Python, designed for simplicity, compatibility, and robustness.
📚 Playground and cheatsheet for learning Python. Collection of Python scripts that are split by topics and contain code examples with explanations.
📷 Instagram Bot - Tool for automated Instagram interactions
Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.
E-mails, subdomains and names Harvester - OSINT
GenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashboards, charts, and SQL across 20+ data sources, such as BigQuery, Snowflake, PostgreSQL, ClickHouse, Amazon Redshift, Databricks and more.
Parlant is an open platform for building customer-facing chat agents with AI. Describe how the agent should behave, and your coding agent implements it for you.
[NeurIPS 2022] Towards Robust Blind Face Restoration with Codebook Lookup Transformer