Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
Repository Index
132,218 visible repositories in the index
745–768 of 2,136 · Most stars
心理健康大模型 (LLM x Mental Health), Pre & Post-training & Dataset & Evaluation & Depoly & RAG, with InternLM / Qwen / Baichuan / DeepSeek / Mixtral / LLama / GLM series models
Get up and running with Llama 3, Mistral, Gemma, and other large language models.by adding more amd gpu support.
📄 🤖 AI for medical and scientific papers
- python
- machine-learning
- nlp
- medical
NBA sports betting using machine learning
- python
- tensorflow
- keras
- nba
The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval
- rag
- retrieval
- retrieval-augmented-generation
- clustering
A native macOS AI chat app powered by MLX. 100% local inference on Apple Silicon, no cloud required. Built with ShipSwift.
- app
- klee
- self-hosted
- apple-silicon
Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.
- extraction
- tika
- unstructured
The WeightWatcher tool for predicting the accuracy of Deep Neural Networks
Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard
- glue
- language-understanding
- bert
- pre-trained-model
A highly-customizable web-based client for Azure Bot Services.
- bot-framework
- adaptive-cards
- azure-bot-services
- chat
Router that virtually distributes inference across connected devices in the home.
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
- agents
- calibration
- classification
- decision-making
Synthetic data curation for post-training and structured data extraction
Pure C inference of Mistral Voxtral Realtime 4B speech to text model
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
Chat2API enables zero-cost access to leading AI models by leveraging official web UIs. It supports providers such as DeepSeek, GLM, Kimi, MiniMax, Qwen, and Z.ai, and seamlessly integrates with tools like openlcaw, Cline, and Roo-Code.
- chatgpt-api
- deepseek-chat
- free-api
- glm-5
This tool provides an efficient implementation of the continuous bag-of-words and skip-gram architectures for computing vector representations of words. These representations can be subsequently used in many natural language processing applications and for further research.
A modular Codex Skill for directing and expanding detailed AI female portrait prompts.
- ai-image-generation
- codex
- codex-skill
- open-source
Official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, Heng Ji.
- llm
- llm-agent
- llm-finetuning
- llm-framework
Cluely - The invisible desktop assistant that provides real-time insights, answers, and support during meetings, interviews, presentations, and professional conversations.
- ai-note-taking-app
- cheating
- cluely
- fireflies
All-in-One Multimodal Parsing Engine + Ontology-Powered, LLM Wiki-Driven AI-Ready Knowledge Engine
- agent
- agent-skills
- asr
- fde
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
A free AI assistant and survival library that runs on your own computer, with no internet needed. Shows the source of every answer.