Sign in

Repository Index

47,133 repositories indexed

Tags: LLM tools
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

73–94 of 94 · Most stars

Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.

  • calibration
  • cuda
  • cuda-graphs
  • decision-making

TranslatedBig Blue Fish desktop pet with local LLM. A Windows AI desktop pet with a built-in 4B local large model. It uses a whale-girl persona that combines weather, tech news and the current application to keep you gentle company through text bubbles. Supports one-click installation and pausing inference when off power.

  • ai-companion
  • deepseek
  • desktop-companion
  • desktop-pet

Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.

MobiInfer runs 35B-A3B-class MoE models fully on-device on the Qualcomm Hexagon NPU, streaming experts from flash with lookahead scheduling (LES) and DSpark speculation.

PocketStrike is a privacy-first mobile AI workstation. It combines zero-cloud native on-device GGUF inference (ARM NEON accelerated) │ with frontier cloud LLMs, multi-step ReAct agent tools, Model Context Protocol (MCP) servers, self-evolving cross-session memory, and FLUX neural image │ generation.

DeepWrite AI is Made with the Help of ChatGPT3 and Specific Model is Prepared for Generating Perfect Blog Post with atmost Clarity. This is Just the Version 1.0 More Improvement Will be Implemented.

  • ai
  • api
  • chatgpt3
  • fullstack-development

Manage and use multiple Ollama instances with automatic offline detection/failover and model availability tracking

FairPlayCombined is a platform designed to accelerate app development using .NET, Blazor, and more. It includes real-world templates like video sharing and dating apps, reducing costs and time-to-market. Perfect for developers, startups, and businesses, it empowers innovation and delivers value with pre-built tools and resources.

  • aspire
  • blazor
  • csharp
  • dotnet

Claude Code dashboard: see where your limits are headed before you hit them. Calibrated usage forecasts, live rate-limit gauges, session costs, memory browser. Single binary, zero config, plus a VS Code extension.