looped-transformers

A theoretical reconstruction of the Claude Mythos architecture, built from first principles using the available research literature.

LoopFormer is an elastic-depth looped Transformer trained on variable-length trajectories, using time/step-size conditioning and a shortcut-consistency objective to enable budget-conditioned language modeling and latent reasoning without retraining.

An open, visual atlas of looped transformers, recurrent computation, adaptive depth, and latent reasoning.

FlashLoop: Fast and Memory-Efficient Looped Transformers via Lazy Updates

Lev: Thinking Fast and Deep with Looped Decision Models. One checkpoint, multiple depths: System 1.5 decision models that think in loops, not tokens.

235 papers on looped and recursive Transformers, latent reasoning, and test-time compute. Bilingual EN/ZH atlas with official code and summaries. 持续更新的 Loop Transformer 研究图谱。

Awesome list of papers, code, models and blogs on Looped / recurrent-depth / weight-tied Transformers — depth as a third scaling axis

Experimental implementation of "Looped Transformers are Better at Learning Learning Algorithms" showing superior performance with 12x fewer parameters. Includes complete environment setup, pre-trained weights, and extensive experiments comparing Looped TFs vs traditional Transformers for In-Context Learning.

Evaluator probes and branch-selection scaffolding for Ouro-RLTT loop states.

Jacobian stability bounds for a looped Transformer block with MSA, FFN and RMSNorm (AINL 2026)

A comprehensive experimental lab for Looped Transformers from scratch. Includes an automated ablation pipeline (ExperimentTable) and a real-time monitoring dashboard.

Lightweight pairwise evaluator for relational signals in Ouro-2.6B-Thinking loop-state trajectories.

Lifetime meta-learning on Ouro-RLTT looped transformers: the O1 oracle-reachability program (sealed v1.5.3->v2.1 + B200 runner), M+N backbone-training and branch-training reports. Companion to Hidden-State-Evaluator (RPE) and Branching-Looped-Transformer (OPI).

Deployment-blocking bugs, a Looped-Transformer memory bound, and a chunked-prefill fix for running Nanbeige4.2-3B on Apple Silicon (MPS)

A teaching-scale looped transformer (recurrent-depth) inspired by GPT-6 Astra, built from scratch in PyTorch. Features shared-weight loops, per-token depth policies, test-time loop scaling, and audited runs.

An implementation of the leworldmodel using looped transformer

Curated, protocol-annotated list of Tiny Recursive Models (TRM), HRM, and recursive reasoning models: papers, code, benchmarks, and results

Benchmark and evaluation ByteDance Ouro model based on Looped Language Models on several reasoning tasks.

J-Lens (Jacobian lens) versus the raw logit lens in the looped Ouro-2.6B: discovery, independent refits, frozen 160-item confirmation, verification, and closeout records. Companion to the working paper 'J-Lens in Ouro: A Confirmed Late-Pass Band and a Target-Dependent Early-Pass Deficit'.

awesome-looped-transformers