Trending repositories

101.opendataloader-project / opendataloader-pdf

PDF Parser for AI-ready data. Automate PDF accessibility. Open-source.

• json
• markdown
• pdf
• ai
• document-parsing
• html
• +14 more

102.agentgateway / agentgateway

Next Generation Agentic Proxy for AI Agents and MCP servers

• agents
• ai
• mcp
• rust
• ai-gateway
• gateway-api
• +5 more

103.langbot-app / LangBot

TranslatedProduction-grade platform for building agentic IM bots - Agent, knowledge base orchestration, plugin system / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信 (Qiye Weixin, "Enterprise WeChat"), 企微智能机器人 (Qiwei Zhineng Jiqiren, "Enterprise WeChat smart bot"), 公众号 (Gongzhonghao, "official account")) / 飞书 (Feishu, "flying book") / 钉钉 (Dingding, "nail nail") / QQ / Matrix e.g. Integrated with ChatGPT(GPT), DeepSeek, Dify, n8n, Langflow, Coze, Claude, Gemini, GLM, Ollama, SiliconFlow, Kimi, openclaw / hermes agent, deerflow

• qq
• openai
• agent
• llm
• wechat
• telegram
• +14 more

104.cobanov / PS5LM

llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8

• homebrew
• llama-cpp
• llm
• playstation-5
• ps5
• qwen

105.LearnPrompt / awesome-seedance

🎬 Evidence-led Seedance 2.5 / 2.0 prompt library: 840+ cases traced to original posts, 490+ cross-model retest runs, 27 copy-ready templates, 79 installable AI-video Skills. Synced daily from goodcase.ai. EN / 中文 / 日本語.

• ai-video
• awesome
• bytedance
• prompt-engineering
• prompts
• seedance
• +13 more

106.6shenhonghong9 / dsh-startup-screen

TranslatedStartup screen and startup animation plugin for DeepSeek Harness

• dsh
• dsh-plugin
• harness
• plugin
• startup-animation

107.FengZhenfei / carrel

Ontology-Augmented Generation for AI agents.

• agent-skills
• document-parsing
• knowledge-graph
• mineru
• neo4j
• ontology
• +7 more

108.sgaofen / humanizer-local-model

Rewrites AI drafts so they read like a person wrote them — runs locally, keeps the facts

• gguf
• humanizer
• llama-cpp
• llm
• local-llm
• rewriting

109.czg86389-hub / muse2api

TranslatedOpenAI-compatible API for Muse.ai with Chat, Image & Video generation. It wraps Muse (muse.ai) via reverse engineering as an OpenAI-compatible interface, supporting chat, text-to-image, text-to-video/image-to-video, multi-account pool rotation, and 48h automatic renewal.

110.deeplethe / utopia

World's first open-source enterprise world model.

• agent-memory
• knowledge-base
• knowledge-graph
• llm
• pgvector
• postgresql
• +9 more

111.janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

• llamacpp
• localai
• self-hosted
• gpt
• tauri
• chatgpt
• +2 more

112.nesquena / hermes-webui

Hermes WebUI: The best way to use Hermes Agent from the web or from your phone!

• agent
• hermes
• ai-agents
• hermes-agent
• nous-research

113.mode-io / vllm-jev

Native vLLM serving for Jev decision models

114.syv-ai / HyperQwen

Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.

• kv-cache
• llm-inference
• local-llm
• quantization
• qwen
• qwen3
• +6 more

115.confident-ai / deepeval

The LLM Evaluation Framework

• evaluation-metrics
• evaluation-framework
• llm-evaluation
• llm-evaluation-framework
• llm-evaluation-metrics
• python

116.hiyouga / LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

• fine-tuning
• llama
• llm
• peft
• transformers
• rlhf
• +14 more

117.Open-LLM-VTuber / Open-LLM-VTuber

Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms

• ai-vtuber
• ai-waifu
• ai
• neuro-sama
• chatbots
• live2d
• +4 more

118.vercel / ai

The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents

• artificial-intelligence
• javascript
• language-model
• llm
• openai
• react
• +9 more

119.datalab-to / marker

Convert PDF to markdown + JSON quickly with high accuracy

120.pydantic / pydantic-ai

How Python does AI. Agents, realtime voice, image generation, embeddings. Every model, every interface, typed end to end.

• agent-framework
• pydantic
• python
• genai
• llm
• harness
• +1 more

121.mdpsec / bug-bounty-hunting-prompts

Reusable prompts for a structured, evidence-first bug bounty hunting workflow

• application-security
• bug-bounty
• bug-bounty-hunting
• cybersecurity
• llm-prompts
• open-source
• +6 more

122.GeeeekExplorer / nano-vllm

Nano vLLM

• inference
• llm
• pytorch
• transformer
• deep-learning
• nlp

123.xinxuxin / keystone-bench

A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.

• ai-safety
• benchmark
• clinical-decision-support
• dataset
• evaluation
• health
• +4 more

124.HKUDS / LightRAG

[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation

• knowledge-graph
• large-language-models
• retrieval-augmented-generation
• genai
• graphrag
• llm
• +5 more

125.0xk1h0 / ChatGPT_DAN

ChatGPT DAN, Jailbreaks prompt

• chatgpt
• jailbreak
• openai
• prompt
• gpt-4
• gpt-3-5

126.srbhr / Resume-Matcher

The #1 AI Harness for Building Resumes, PDFs, Cover Letters & more, locally with 100+ LLMs support.

• text-similarity
• natural-language-processing
• word-embeddings
• python
• machine-learning
• resume
• +8 more

127.hardenrun / aif

On device Firewall for Coding and Personal Agents

128.nokia-applied-research / AnyJev

Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (continue updating, welcome any issue and PR request)

• calibration
• decision-model
• jev
• jev-model
• llm
• system-one
• +2 more

129.openobserve / openobserve

Open source observability platform for logs, metrics, traces, RUM (web, android, ios), Session replay, pipelines, SLO and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage costs and single binary deployment.

• logs
• metrics
• traces
• analytics
• elasticsearch
• jaeger
• +14 more

130.ThinkWatchProject / ThinkWatch-Lite

Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.

• ai-gateway
• anthropic
• claude-code
• codex
• cost-tracking
• llm-gateway
• +14 more

131.xzf-thu / VoiceMem

Infrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a right brain, storing information and emotions respectively, while a fully streaming architecture eliminates latency at the fundamental level.

• ai
• ai-agents
• ai-tools
• application
• audio-streaming
• genai
• +7 more

132.FoShmily / ai-paper-system

TranslatedAI Paper System · AI paper generation, AI paper writing, one-click paper generation, AIGC rate reduction, plagiarism similarity reduction, thesis defense PPT · OEM white-label franchise recruitment

• ai
• ai-humanizer
• ai-ppt
• aigc
• deepseek
• llm
• +4 more

133.gufo-org / gufo

The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B Q4_K_XL: 656.33pp, 70.56tg tok/s single user with DFlash2

• amd
• llm
• strix-halo
• gfx1151
• ryzen-ai

134.musistudio / claude-code-router

One local control plane for every AI agent: route across models, fuse new capabilities, orchestrate tools, and stay fully in control.

135.ComposioHQ / composio

Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.

• ai
• python
• agents
• aiagents
• function-calling
• developer-tools
• +11 more

136.mikeroyal / Self-Hosting-Guide

Self-Hosting Guide. Learn all about locally hosting (on premises & private web servers) and managing software applications by yourself or your organization. Including Cloud, LLMs, WireGuard, Automation, Home Assistant, and Networking.

• self-hosted
• selfhosted
• home-assistant
• wireguard
• decentralized
• self-hosting
• +14 more

137.yamadashy / repomix

📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.

• ai
• llm
• generative-ai
• chatgpt
• claude
• developer-tools
• +14 more

138.PointAntStorm / grok-self

grok-cli-self the lightweight, zero-dependency Grok CLI. Chat with xAI's Grok AI (Grok 4) in your terminal: one-shot prompts

• ai-assistant
• ai-assistants
• ai-chatbo
• chatgpt-alternative
• cli
• cli-tool
• +10 more

139.securetron-gh / aifw

AI Agent Identity and Access Management and Inference Firewall

• agent-identity
• ai-audit
• ai-firewall
• ai-gateway
• ai-governance
• ai-security
• +4 more

140.supermemoryai / supermemory

Memory and context engine + app that is extremely fast, scalable, and can be run fully locally. The Memory API for the AI era.

• cloudflare-pages
• cloudflare-workers
• drizzle-orm
• tailwindcss
• typescript
• cloudflare-kv
• +6 more

141.exo-explore / exo

Run frontier AI locally.

142.adtexterry-lgtm / unigit-ecosystem

UNIGIT public brand and ecosystem hub — AI should work for everyone.

• agentic-ai
• ai-tools
• ai-workbench
• ecosystem
• mcp
• productivity
• +1 more

143.MODSetter / SurfSense

Air-gapped, privacy-focused, open-source NotebookLM alternative. AI agent that researches, transforms, and edits your documents. Join our Discord: https://discord.gg/ejRNvftDp9

• ai
• rag
• notebooklm
• agent
• agents
• notebooklm-alternative
• +3 more

144.superwesleyhys-ux / factcircuit

FactCircuit: an auditable claim-and-evidence verification loop with immutable provenance, staged checks, bounded retrieval, and reproducible evaluation.

• accuracy-decline
• ai-safety
• audit-trail
• fact-checking
• information-retrieval
• llm-evaluation
• +5 more

145.slee-persis / GVS5H

GVS5H: Five Qwen3.8-27B Models Match Claude Fable 5 on LiveCodeBench Hard | Fable 5 Level Coding for a Fifth the Price - or on a Single GPU

146.khoj-ai / khoj

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

• semantic-search
• emacs
• obsidian-md
• chat
• chatgpt
• ai
• +14 more

147.AIMS-RAIL / RAIL

The repository host gives no description.

148.Soulmate-Halo / heterogeneous-gpu-pd-lab

TranslatedUsing dense-compute cards to accelerate sparse, large-VRAM hosts, where the hosts include AI Max+ 395, M3 512G, DGX Spark, and others.

• llama-cpp
• pipeline-parallelism
• prefill-decode
• rtx-3060
• strix-halo
• heterogeneous-gpu

149.NVIDIA / garak

the LLM vulnerability scanner

• ai
• llm-evaluation
• llm-security
• security-scanners
• vulnerability-assessment

150.danielmiessler / Fabric

Fabric is an open-source framework for augmenting humans using AI. It provides a modular system for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.

• ai
• augmentation
• flourishing
• life
• work

151.shuishuipingan / qoder2api-hub

TranslatedQoder international and China multi-account reverse proxy gateway, a multi-account OpenAI-compatible gateway hub for Qoder's international and China dual regions — COSY-signed inference, stable device fingerprints to avoid risk control, OAuth device authorization for client-free login, daily check-in and Pro benefits, background scheduled task scheduler, web monitoring dashboard, supporting Codex / Claude Code and standard OpenAI clients

• aliyun
• api-gateway
• claude-code
• codex
• dashboard
• deepseek
• +8 more

152.stanfordnlp / dspy

DSPy: The framework for programming—not prompting—language models

153.TreapGoGo / deepseek-whale-girl

TranslatedA community-maintained fan-creation resource library for the Whale Girl (鲸鱼娘), collecting character reference images, generation prompts, community works, and related projects, giving creators convenient and easy-to-use references and inspiration. This is an unofficial community project and does not represent the official position of DeepSeek.

154.run-llama / llama_index

LlamaIndex is the document processing platform for AI

• agents
• application
• data
• fine-tuning
• framework
• llamaindex
• +4 more

155.a2aproject / A2A

Agent2Agent (A2A) is an open protocol enabling communication and interoperability between opaque agentic applications.

• a2a
• a2a-mcp
• a2a-protocol
• a2a-server
• agents
• generative-ai
• +1 more

156.Arize-ai / phoenix

AI Observability & Evaluation

• llmops
• ai-monitoring
• ai-observability
• llm-eval
• aiengineering
• datasets
• +10 more

157.vercel-labs / json-render

The Generative UI framework

158.mlflow / mlflow

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

• machine-learning
• ai
• ml
• mlflow
• apache-spark
• model-management
• +12 more

159.mozilla-ai / llamafile

Distribute and run LLMs with a single file.

• cross-platform
• gguf
• llama-cpp
• local-ai
• local-inference
• local-llm
• +3 more

160.haolpku / Omni-Edu

OmniEdu: Open Foundation Models for Learning and Teaching

161.chatboxai / chatbox

Powerful AI Client

• chatgpt
• openai
• copilot
• gpt
• chatbot
• ollama
• +6 more

162.verl-project / verl

verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework

163.google-ai-edge / gallery

A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.

164.Calcium-Ion / AstrLink

A local AI gateway for AI agents, unifying your subscriptions and API providers with smart routing and on-device privacy protection.

• ai-gateway

165.Cygnux-Labs / Tracekit

Tamper-evident tracing, policy gates and cross-checks for AI agents: see what the agent did, and why.

• agent-security
• ai-agents
• audit-log
• claude-code
• llm
• mcp
• +14 more

166.google / langextract

A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.

• llm
• nlp
• python
• gemini-ai
• information-extration
• large-language-models
• +5 more

167.xtekky / gpt4free

The official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3

• chatgpt
• chatgpt-4
• chatgpt4
• gpt
• gpt-4
• gpt4
• +14 more

168.higress-group / HiRoute

Make Codex and Claude Code subscriptions go further: a local model router that gives routine agent work to economical models and keeps your strongest model for the hard parts.

• model-routing
• task-routing
• ai-agents
• ai-gateway
• claude-code
• codex
• +8 more

169.microsoft / graphrag

A modular graph-based Retrieval-Augmented Generation (RAG) system

• graphrag
• rag
• llm
• llms
• gpt
• gpt-4
• +1 more

170.XDTrees / dsh-xdpool

TranslatedConnect all the model quotas you can get for free into the same DSH pool: automatic multi-account fault tolerance for WorkBuddy, QR-code login for 13 providers, aggregation of free quotas from 76 providers, a usage dashboard, model routing, a local OpenAI gateway, and automated points collection.

• codebuddy
• dsh-plugin
• failover
• model-provider
• multi-account
• workbuddy
• +3 more

171.microsoft / agent-lightning

The absolute trainer to light up AI agents.

• agent
• agentic-ai
• llm
• mlops
• reinforcement-learning

172.openai / openai-python

The official Python library for the OpenAI API

• openai
• python

173.xyz-rafael-xyz / roguard-child-safety

Romanian and Ukrainian child-safety structured-check toolkit and synthetic research records

174.ml-explore / mlx-lm

Run LLMs with MLX

• llms
• mlx

175.songquanpeng / one-api

TranslatedLLM API management & key redistribution system, unifying multiple providers under a single API. Single binary, Docker-ready, with an English UI. Supports mainstream models such as OpenAI, Azure, Anthropic Claude, Google Gemini, DeepSeek, 字节豆包 (Doubao, "bean bun", from ByteDance), ChatGLM, 文心一言 (Wenxin Yiyan, "literary heart, one utterance"), 讯飞星火 (Xunfei Xinghuo, "iFlytek Spark"), 通义千问 (Tongyi Qianwen, "Tongyi thousand questions"), 360 智脑 (360 Zhinao, "360 smart brain") and 腾讯混元 (Tencent Hunyuan, "primordial chaos"), with unified API adaptation, usable for key management and secondary distribution. One-click deployment, ready to use out of the box.

• openai-api
• proxy
• chatgpt
• gpt
• openai
• api
• +5 more

176.baidu-baige / LoongSage

A production-grade, high-efficiency Agentic RL framework for frontier LLMs with validated recipes.

177.vibrantlabsai / ragas

Supercharge Your LLM Application Evaluations 🚀

• llm
• llmops
• evaluation

178.onlook-dev / onlook

The Developer Tool for Visual Engineers • An Open-Source AI-First Design tool • Visually build, style, and edit your code with AI • World's best, top-most agent recommended #1 Developer tool for Designers and Visual Engineers to design with Real Code.

• react
• typescript
• tailwindcss
• nextjs
• design
• frontend
• +14 more

179.thomasunise / casecite

CaseCite is an open-source, self-hosted legal RAG caselaw research & document analysis platform.

• legal
• legal-ai
• legal-tech
• legaltech
• caselaw
• legal-research
• +8 more

180.deepset-ai / haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

• semantic-search
• information-retrieval
• ai
• python
• large-language-models
• generative-ai
• +14 more

181.LC044 / WeChatMsg

The repository host gives no description.

• wechat
• pyqt
• chatgpt
• llms

182.voyager-crew / voyager

TranslatedEnhancement suite for Gemini, AI Studio, Claude, ChatGPT & DeepSeek — plus a prompt manager for any website, DeepSeek Harness included.

• chat-management
• chrome-extension
• gemini
• ai-studio
• safari-extension
• bun
• +7 more

183.datalab-to / chandra

OCR model that handles complex tables, forms, handwriting with full layout.

• ai
• ocr

184.Piebald-AI / claude-code-system-prompts

All parts of Claude Code's system prompt, 27 builtin tool descriptions, sub agent prompts (Plan/Explore/Task), utility prompts (CLAUDE.md, compact, statusline, magic docs, WebFetch, Bash cmd, security review, agent creation). Updated for each Claude Code version.

• claude-code
• claude-code-system-prompts
• system-prompts

185.Shyboy0499 / precondition-library

An agent that compiles git maintenance chores into reusable programs, then decides whether to replay them by running checks rather than by guessing the task looks familiar

• agent-architecture
• git-automation
• llm-agents
• program-synthesis
• research

186.WenyuChiou / ai-research-skills

Universal SKILL.md catalog for research workflows: literature review, research design, project memory, manuscript writing, and cross-agent delegation for Claude Code, Codex, Gemini, Cursor, OpenClaw, and generic AI clients.

• academic-writing
• ai-skills
• notebooklm
• obsidian
• zotero
• claude-code
• +14 more

187.rsi-gear / gear

Scikit-learn for Recursive Self-improvement (RSI). A modular framework for recursive harness evolution.

• meta-learning
• reinforcement-learning
• rsi
• ai-agents
• continual-learning
• infrastructure
• +6 more

188.binary-husky / gpt_academic

TranslatedProvides a practical interactive interface for large language models (LLMs) such as GPT/GLM, with special optimization for the paper reading/polishing/writing experience. Modular design, supports custom shortcut buttons & function plugins, supports project analysis & self-translation for Python, C++ and other projects, PDF/LaTeX paper translation & summarization, supports querying multiple LLM models in parallel, and supports local models such as chatglm3. Integrates Tongyi Qianwen (Qwen), deepseekcoder, iFlytek Spark, ERNIE Bot (Wenxin Yiyan), llama2, rwkv, claude2, moss, and more.

• academic
• chatglm-6b
• chatgpt
• large-language-models
• gpt-4

189.GeminiLight / SocialCoach

Your personal EQ coach. Build social skills and learn to handle conflict through realistic role-play and personalized feedback.

• ai-in-education
• communication-skills
• conflict-resolution
• llm
• personalized-learning
• role-play
• +2 more

190.www222fff / muse2api

OpenAI-compatible async gateway for muse.ai with pluggable drivers (mock / browser-CDP / http)

191.EleutherAI / lm-evaluation-harness

A framework for few-shot evaluation of language models.

• evaluation-framework
• language-model
• transformer

192.coderamp-labs / gitingest

Replace 'hub' with 'ingest' in any GitHub URL to get a prompt-friendly extract of a codebase

• ai
• code
• ingestion
• developer-tool

193.NVIDIA / TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

• blackwell
• cuda
• moe
• pytorch
• llm-serving

194.ChatGPTNextWeb / NextChat

✨ Zero-config AI chat assistant. No API key needed — sign up and instantly chat with GPT-5, Claude 4, Gemini 2.5, DeepSeek & 100+ top models. Pay-as-you-go saves you more. Available on Web, iOS, macOS, Android, Linux, Windows.

• nextjs
• vercel
• webui
• cross-platform
• tauri
• tauri-app
• +12 more

195.modelscope / ms-swift

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

• llm
• lora
• sft
• multimodal
• peft
• liger
• +13 more

196.YichengYang-Ethan / oracle3-prediction-market-agent

Oracle3: open-source trading engine and MCP server for prediction markets. Finds fee-adjusted no-arbitrage violations across related event contracts and trades them live on Kalshi, Polymarket and Solana, or on paper, under pre-trade risk limits. 13 MCP tools, JSON CLI, agent skills, 600+ tests.

• algorithmic-trading
• kalshi
• polymarket
• python
• quantitative-finance
• trading-bot
• +14 more

197.Tencent / WeVisDoc

WeVisDoc is an end-to-end document parser for page images. Fine-tuned from Qwen3-VL-2B-Instruct and Qwen3-VL-4B-Instruct, it turns a page into structured Markdown, with LaTeX formulas and HTML tables.

198.1Panel-dev / MaxKB

Translated🔥 MaxKB is an open-source platform for building enterprise-grade agents. A powerful and easy-to-use open-source enterprise-grade agent platform.

• llm
• ollama
• maxkb
• knowledgebase
• chatbot
• langchain
• +8 more

199.carloslfu / slotstream

Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

• apple-silicon
• llm
• llm-inference
• local-llm
• macos
• mixture-of-experts
• +12 more

200.pymupdf / PyMuPDF

PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.

• mupdf
• xps
• pdf-documents
• epub
• ocr
• pdf
• +9 more