Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
Repository Index
100,822 visible repositories in the index
217–240 of 6,878 · Most stars
Train transformer language models with reinforcement learning.
Machine Learning Engineering Open Book
- pytorch
- slurm
- large-language-models
- llm
The best free and open-source automated time tracker. Cross-platform, extensible, privacy-focused.
- quantified-self
- activitywatch
- productivity
- time-tracking
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Faker is a Python package that generates fake data for you.
ARIS ⚔️ (Auto-Research-In-Sleep) — Lightweight Markdown-only skills for autonomous ML research: cross-model review loops, idea discovery, and experiment automation. No framework, no lock-in — works with Claude Code, Codex, OpenClaw, or any LLM agent.
- ai-research
- autonomous-agent
- claude-code
- codex
State-of-the-Art Embeddings, Retrieval, and Reranking
SkillOpt is a text-space optimizer that trains reusable natural-language skills for frozen LLM agents through trajectory-driven edits, validation-gated updates, and deployable best_skill.md artifacts.
- agent-skills
- self-evolving-agents
Run Windows Subsystem For Android on your Windows 10 and Windows 11 PC using prebuilt binaries with Google Play Store (MindTheGapps) and/or Magisk or KernelSU (root solutions) built in.
- windows
- windows-10
- windows-11
- magisk
TranslatedProduction-grade platform for building agentic IM bots - Agent, knowledge base orchestration, plugin system / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信 (Qiye Weixin, "Enterprise WeChat"), 企微智能机器人 (Qiwei Zhineng Jiqiren, "Enterprise WeChat smart bot"), 公众号 (Gongzhonghao, "official account")) / 飞书 (Feishu, "flying book") / 钉钉 (Dingding, "nail nail") / QQ / Matrix e.g. Integrated with ChatGPT(GPT), DeepSeek, Dify, n8n, Langflow, Coze, Claude, Gemini, GLM, Ollama, SiliconFlow, Kimi, openclaw / hermes agent, deerflow
Experience macOS just like before
- opencore
- patcher
- big-sur
- macos
The absolute trainer to light up AI agents.
The interactive graphing library for Python :sparkles:
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
- machine-translation
- speaker-recognition
- asr
- tts
A Study Path for Game Programmer
An open source platform for Python in the browser. https://pyscript.net Docs: https://docs.pyscript.net/ Try it: https://pyscript.com/ Community: https://discord.gg/HxvBtukrg2
[ECCV 2026 Best Paper Award Candidate] LingBot-Map: Geometric Context Transformer for Streaming 3D Reconstruction
SQL databases in Python, designed for simplicity, compatibility, and robustness.
- python
- sql
- sqlalchemy
- pydantic
A Patch for GIMP 3+ for Photoshop Users
📚 Playground and cheatsheet for learning Python. Collection of Python scripts that are split by topics and contain code examples with explanations.
- python
- python3
- learning
- programming-language
Open Source DeepWiki: AI-Powered Wiki Generator for GitHub/Gitlab/Bitbucket Repositories. Join the discord: https://discord.gg/gMwThUMeme
Ongoing research training transformer models at scale
- large-language-models
- model-para
- transformers