Repository Index

A computer, compiled into the weights of a language model. An exact CPU inside Qwen3.5-4B, with Gated DeltaNet state as RAM.

• gated-deltanet
• interpretability
• llm
• qwen

:sunrise: A comprehensive, cutting-edge open-source framework for next-generation Transformers/LLM, with compute-matched benchmarking and a platform for autonomous architecture research.

• auto-research
• benchmark
• deep-learning
• language-models

Extract knowledge from all information sources using gpt and other language models. Index and make Q&A session with information sources.

• gpt
• openai
• context
• embedding

Run transformers directly on Apple's Neural Engine in Swift bypass coreml entirely

• ane
• apple
• apple-neural-engine
• neural-engine

Research experiments exploring uncommon quant techniques.

• analysis
• jupyter-notebook
• python
• quant

Code and data for the paper "Evaluating German Transformer Language Models with Syntactic Agreement Tests" (Zaczynska et al., 2020)

• bert
• transformers
• syntactic-agreement
• german

A minimalistic codebase for training NLG models from HuggingFace Transformers using PyTorch Lightning.

• bart
• generation
• gpt-2
• language-model