dabnn is an accelerated binary neural networks inference framework for mobile platform
Repository Index
132,241 visible repositories in the index
577–600 of 748 · Most stars
Example notebooks for working with SageMaker Studio Lab. Sign up for an account at the link below!
- amazon-sagemaker-lab
- sagemaker-studio-lab
- machine-learning
- deep-learning
Embedded and mobile deep learning research resources
- efficient-neural-networks
- deep-neural-networks
- deep-learning
- mobile-ai
AI Productivity Tool - Free and open source, improve user productivity, and protect privacy and data security. Including but not limited to: built-in local exclusive ChatGPT, DeepSeek, Phi, Qwen and other models, one-click batch intelligent processing of pictures, videos, audio, etc.
- ai
- ai-framework
- computer-vision
- deep-learning
Blind WAF identification tool
One API for all LLMs either Private or Public (Anthropic, Llama V2, GPT 3.5/4, Vertex, GPT4ALL, HuggingFace ...) 🌈🐂 Replace OpenAI GPT with any LLMs in your app with one line.
AI Engineering Course - A free and complete AI Engineering Course to learn AI Engineering step by step - from Machine Learning, Neural Networks, and Transformers to LLMs, Fine-Tuning, RAG, AI Agents, LLM Inference, Evaluation, AI Safety, and AI System Design.
- ai-course
- ai-engineering
- ai-engineering-course
- ai-engineering-curriculum
A Python implementation of active inference for Markov Decision Processes
LLM papers I'm reading, mostly on inference and model compression
Must-read papers and resources related to causal inference and machine (deep) learning
- causal-inference
- causal-models
- counterfactual
- treatment-effects
Infer# is an interprocedural and scalable static code analyzer for C#. Via the capabilities of Facebook's Infer, this tool detects null dereferences, resource leaks, and thread-safety violations. It also performs taint flow tracking to detect critical security vulnerabilities like SQL injections.
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
- inference
- kimi
- llm-serving
- model-serving
MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveraging the power of local ML inference.
- mlx
- openai
- openai-api
- stt
The Tensor Algebra SuperOptimizer for Deep Learning
- deep-learning
- deep-neural-networks
- inference-optimization
Up to 4× faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash speculative decoding — Gemma-4, Qwen3.8, Muse-Glimmer, Nemotron, LFM2.5, Ornith-1.0, ternary Bonsai-27B.
- apple-silicon
- claude-code
- codex
- dflash2
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
SparkDiffusion: Accelerating DiT video generation by 265× via joint Sparsity, Distillation, Quantization, etc.
- diffusion-models
- distillation
- high-sparsity
- inference-acceleration
推荐系统入门指南,全面介绍了工业级推荐系统的理论知识(王树森推荐系统公开课-基于小红书的场景讲解工业界真实的推荐系统),如何基于TensorFlow2训练模型,如何实现高性能、高并发、高可用的Golang推理微服务。Comprehensively introduced the theory of industrial recommender system, how to trainning models based on TensorFlow2, how to implement the high-performance、high-concurrency and high-available inference services base on Golang.
- recommender-systems
Pure Rust Inference Engine
- cuda
- gb10
- llm-inference
- mamba
🔥 (yolov3 yolov4 yolov5 unet ...)A mini pytorch inference framework which inspired from darknet.
- yolov3
- yolov4
- yolov5
- pytorch
37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.
- avx2
- c
- cpu-inference
- gguf
Official Hi3D v1.0: high-resolution 3D geometry refinement built on Sparc3D. Inference code, model weights, and documentation.
- 3d-generation
- image-to-3d
- geometry-refinement
- sparc3d
Accurate, large-scale, and extensible simulator for LLM inference Systems
The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.
- deeplearning
- pipelines
- machinelearning
- jupyterlab