Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
RAGLight is a modular framework for Retrieval-Augmented Generation (RAG). It makes it easy to plug in different LLMs, embeddings, and vector stores, and now includes seamless MCP integration to connect external tools and data sources.
A curated list of awesome resources for quantitative investment and trading strategies focusing on artificial intelligence and machine learning applications in finance.
Starter app to build with OpenAI ChatKit SDK
Official python implementation of UTCP. UTCP is an open standard that lets AI agents call any API directly, without extra middleware.
NBoost is a scalable, search-api-boosting platform for deploying transformer models to improve the relevance of search results on different platforms (i.e. Elasticsearch)
Assistant: AI Helper Plugin for KOReader : lets you interact with AI language models (Claude, GPT-4, Gemini, DeepSeek, Ollama etc.) while reading
PyTorch Code for Energy-Based Transformers paper -- generalizable reasoning and scalable learning
Recap AI for YouTube summaries, a searchable transcript and chat about the video
Open Source project using LLMs to transcribe and translate subtitles (SRT, SSA/ASS, VTT)
On-device AI for Flutter — Gemma and other LLMs, multimodal, function calling, embeddings, RAG and speech on Android, iOS, Web, macOS, Windows and Linux.
Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM, including on iPhone.
- local-llm
- mixture-of-experts
- on-device-ai
- qwen
Agent skill for color science expertise. Many references covering color spaces, accessibility (APCA, WCAG), palette generation, pigment mixing, and historical color theory. Works with Claude Code, Codex, Cursor, Copilot & others.
A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery (EMNLP'24)
RAT is a powerful tool that improves AI responses by leveraging DeepSeek's reasoning capabilities to guide other models through a structured thinking process.
Source-available LLM router and AI cost optimizer. Routes simple prompts to cheap or local models and complex ones to premium models, automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor and OpenClaw. Self-hosted, no middleman.
Is ChatGPT Good at Search? LLMs as Re-Ranking Agent [EMNLP 2023 Outstanding Paper Award]
This is the official github repo of Think-on-Graph (ICLR 2024). If you are interested in our work or willing to join our research team in Shenzhen, please feel free to contact us by email ([email protected])
- iclr2024
- knowledge-graph
- llm
➖ Stripped down, stable version of firecrawl optimized for self-hosting and ease of contribution. Billing logic and AI features are completely removed. Crawl and convert any website into LLM-ready markdown.
The most complete open-source Swift package for interacting with OpenAI's public API.
基于Golang/go-zero的AIoT物联网平台与SaaS开发底座,融合AI智能体、RAG知识库、记忆和工具调用。支持多租户、多应用、项目管理、设备管理、物模型、场景联动、告警、组态及3D数字孪生。提供MQTT/CoAP/HTTP/TCP接入及阿里云、腾讯云、涂鸦云对接,支持MySQL/PostgreSQL。借助Skills/CLI快速开发,适用于智慧能源、楼宇、停车、家居、农业与工业。
The unofficial OpenAI SDK for Dart & Flutter. Full API coverage + OpenAI-compatible providers (Azure, DeepSeek, LM Studio, Ollama): Responses, Chat, Realtime, Videos, Batch, Fine-tuning.
- dart
- dart-library
- dart-package
- dartlang
Memento is a Python app that records everything you do on your computer and lets you go back in time, search, and chat with a LLM (Large Language Model) to find back information about what you did.
✨✨Latest Papers and Benchmarks in Reasoning with Foundation Models
- llm
- llm-reasoning
- reasoning
- reasoning-language-models