Repository Index

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

• bloom
• deep-learning
• distributed-systems
• language-models

KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge bases. It can effectively overcome the shortcomings of the traditional RAG vector similarity calculation model.

• knowledge-graph
• large-language-model
• logical-reasoning
• multi-hop-question-answering

CISO Assistant is a one-stop-shop GRC platform for Risk Management, AppSec, Compliance & Audit, TPRM, BIA, Privacy, and Reporting. It supports 200+ global frameworks with automatic control mapping, including ISO 27001, NIST CSF, SOC 2, CIS, PCI DSS, NIS2, DORA, GDPR, HIPAA, CMMC, and more.

• compliance
• grc
• soc2
• gdpr

Toolkit for creating, sharing and using natural language prompts.

• natural-language-processing
• nlp
• machine-learning

TranslatedAI Cross-Border E-commerce Operations Agent Toolkit · Breaks operations SOPs down into 7 reusable AI Agent workflows, including prompts, templates, and real-world cases

• ai-agents
• cross-border-ecommerce
• ecommerce
• llm

Run 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB CPU (0 GPUs).

• avx512
• cpu-inference
• hpc
• llama-cpp

🤖 TUI for LLMs

• chatgpt
• llm
• rust
• tui

Chat with AI. Ready to be deployed. From Bonaroo.

• chat-application
• chatgpt-api
• chatgpt-app
• ruby