Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
XLNet: Generalized Autoregressive Pretraining for Language Understanding
An autoregressive character-level language model for making more things
MAGI-1: Autoregressive Video Generation at Scale
Official codebase for "Self Forcing: Bridging Training and Inference in Autoregressive Video Diffusion" (NeurIPS 2025 Spotlight)
TranslatedNon-autoregressive System 1 decision engine, designed for structured, typed decision-making scenarios. DeepOpen Multilingual, non-autoregressive System 1 decision engine.
Looking Ahead: Modeling Future Evolution in Autoregressive Video Generation