Repository Index

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

• pytorch
• llm
• artificial-intelligence
• machine-learning

Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks

• ingestion-api
• ocr
• omniparser
• parse-server

Inference Llama in Common Lisp

Pipeline de ingestão e busca semântica de documentos para RAG — com rate limiting, circuit breaker e fila resiliente.

• docker
• pipeline
• python
• rag