TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Repository Index
47,133 repositories indexed
25–48 of 189 · Most stars
Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
- ai-vtuber
- ai-waifu
- ai
- neuro-sama
[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
HexStrike AI MCP Agents is an advanced MCP server that lets AI agents (Claude, GPT, Copilot, etc.) autonomously run 150+ cybersecurity tools for automated pentesting, vulnerability discovery, bug bounty automation, and security research. Seamlessly bridge LLMs with real-world offensive security capabilities.
The OWASP Mobile Application Security Testing Guide (MASTG) is a comprehensive manual for mobile app security testing and reverse engineering. It describes technical processes for verifying the OWASP Mobile Security Weakness Enumeration (MASWE) weaknesses, which are in alignment with the OWASP MASVS.
Install and Run Python Applications in Isolated Environments
- pip
- cli
- pypi
- venv
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
- llm
- llmops
- model-inference
- fine-tuning
The repository provides code for running inference and finetuning with the Meta Segment Anything Model 3 (SAM 3), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
Switch games running natively on iPhone, iPad and Mac: an NSP folder becomes an unsigned IPA (NSO rewriter, Horizon HLE host, NVN→Metal)
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
q - Run SQL directly on delimited files and multi-file sqlite databases
- python
- sql
- cli
- command-line-tool
🍦 Never use print() to debug again.
- python
- python3
- library
- inspects
Jev-like family of decision models built on top of Qwen3.5/3.8 you can train and run on your own
- decision-model
- jev
- qwen3
📱 objection - runtime mobile exploration
Run Windows software and games on Linux
- wine
- wineprefix-manager
- python
- bottles
Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a trained router predicts loads a step ahead. Mac, iPhone, Android, Windows supported
Ready-to-run Docker images containing Jupyter applications
A system-level, binary package and environment manager running on all major operating systems and platforms.
- conda
- package-management
- python
Run LLMs with MLX
- llms
- mlx
Robyn is a Super Fast Async Python Web Framework with a Rust runtime.
- rust
- python
- python3
- backend
:bookmark: Personal mini-web in text
- bookmark
- bookmark-manager
- command-line
- standalone
a script to run docker-compose.yml using podman
- podman
- docker-compose
- linux-containers
- rootless-containers
🔧 pyinfra turns Python code into shell commands and runs them on your servers. Execute ad-hoc commands and write declarative operations. Target SSH servers, local machine and Docker containers. Fast and scales from one server to thousands.
- python
- cloud-management
- configuration-management
- remote-execution
A fast and reliable background task processing library for Python 3.
- python
- task-manager
- task-scheduler
- task-runner