Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
Repository Index
47,133 repositories indexed
217–240 of 1,839 · Most stars
Machine Learning Engineering Open Book
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Translate the video from one language to another and embed dubbing & subtitles.
- text-to-speech
- video-transition
- speech-to-text
- stt
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Devika is the first open-source implementation of an Agentic Software Engineer. Initially started as an open-source alternative to Devin.
The best free and open-source automated time tracker. Cross-platform, extensible, privacy-focused.
- quantified-self
- activitywatch
- productivity
- time-tracking
Turns Data and AI algorithms into production-ready web applications in no time.
A TTS model capable of generating ultra-realistic dialogue in one pass.
- ai
- open-weight
- text-to-speech
The LLM Evaluation Framework
- evaluation-metrics
- evaluation-framework
- llm-evaluation
- llm-evaluation-framework
Translated🤖 DIY-able multimodal AI chatbot | 🚀 Quickly connects to chat platforms such as WeChat, QQ, Telegram, and more | 🦈 Supports DeepSeek, Grok, Claude, Ollama, Gemini, OpenAI | Workflow system, web search, AI image generation, persona tuning, virtual maid, voice conversation |
A collection of projects designed to help developers quickly get started with building deployable applications using the Claude API
Open source UI framework written in Python, running on Windows, Linux, macOS, Android and iOS
Let Claude Code, Codex or Cursor use your real Chrome, logged in as you. One prompt to set up. Open source, MIT.
Experience macOS just like before
- opencore
- patcher
- big-sur
- macos
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
- python
- luigi
- orchestration-framework
- scheduling
TranslatedProduction-grade platform for building agentic IM bots - Agent, knowledge base orchestration, plugin system / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信 (Qiye Weixin, "Enterprise WeChat"), 企微智能机器人 (Qiwei Zhineng Jiqiren, "Enterprise WeChat smart bot"), 公众号 (Gongzhonghao, "official account")) / 飞书 (Feishu, "flying book") / 钉钉 (Dingding, "nail nail") / QQ / Matrix e.g. Integrated with ChatGPT(GPT), DeepSeek, Dify, n8n, Langflow, Coze, Claude, Gemini, GLM, Ollama, SiliconFlow, Kimi, openclaw / hermes agent, deerflow
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
- machine-translation
- speaker-recognition
- asr
- tts
An open source platform for Python in the browser. https://pyscript.net Docs: https://docs.pyscript.net/ Try it: https://pyscript.com/ Community: https://discord.gg/HxvBtukrg2
ARIS ⚔️ (Auto-Research-In-Sleep) — Lightweight Markdown-only skills for autonomous ML research: cross-model review loops, idea discovery, and experiment automation. No framework, no lock-in — works with Claude Code, Codex, OpenClaw, or any LLM agent.
- ai-research
- autonomous-agent
- claude-code
- codex
[ECCV 2026 Best Paper Award Candidate] LingBot-Map: Geometric Context Transformer for Streaming 3D Reconstruction
Wan: Open and Advanced Large-Scale Video Generative Models
- aigc
- video-generation
Open Source DeepWiki: AI-Powered Wiki Generator for GitHub/Gitlab/Bitbucket Repositories. Join the discord: https://discord.gg/gMwThUMeme
Build a portrait of your life. Assistants that know you. Clones that talk like you.