Library

Search the public knowledge base.

Machine Learning Reinforcement Learning Transformers LLMs Attention Diffusion 3D hand pose estimation AI infrastructure AI Interpretability AI security

22 results

Sort by

Latest Most read Recently updated

Beyond Reinforcement Learning: Sampling as Optimization for Reasoning Models

Imagine an LLM solving a math problem. It samples a full reasoning trace, you run a verifier, and the verifier returns a number: per...

Machine Learningenergy-based modelsimportance sampling

Aug 28, 2026 18 min read 332

Attention Is All You Need: The Transformer

A diagram-rich generated explanation from the public library.

Machine LearningTransformersAttention

Aug 18, 2026 45 min read 973

Action Chunking with Transformers (ACT): Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware

A diagram-rich generated explanation from the public library.

Machine LearningTransformers

Aug 18, 2026 45 min read 906

B-spline Policy: Continuous Action Curves for Fast Manipulation

A diagram-rich generated explanation from the public library.

Machine Learning

Aug 4, 2026 45 min read 474

DemoSpeedup: Entropy-Guided Acceleration of Visuomotor Policy Learning

A diagram-rich generated explanation from the public library.

Machine Learning

Aug 4, 2026 45 min read 244

HIL-SERL: Human-in-the-Loop Sample-Efficient Robotic Reinforcement Learning for Dexterous Manipulation

A diagram-rich generated explanation from the public library.

Machine LearningReinforcement Learning

Jun 10, 2026 45 min read 901

Imitation Bootstrapped Reinforcement Learning (IBRL)

A diagram-rich generated explanation from the public library.

Machine LearningReinforcement Learning

Jun 2, 2026 45 min read 348

Imitation Bootstrapped Reinforcement Learning (IBRL): Using Demonstrations in Exploration and Bootstrapping

A diagram-rich generated explanation from the public library.

Machine LearningReinforcement Learning

May 26, 2026 45 min read 217

KV Caching in Autoregressive Transformers

KV Caching

Machine LearningTransformersAttention

May 26, 2026 45 min read 537

Odysseus: Stable RL Training of VLMs for Long-Horizon Game Decision-Making

A diagram-rich generated explanation from the public library.

Machine LearningReinforcement Learning

May 18, 2026 45 min read 210

ECHO: Turning Terminal Feedback into Dense Supervision for Agent RL

A diagram-rich generated explanation from the public library.

Machine LearningReinforcement Learning

May 18, 2026 45 min read 177

Vision-Language-Action Models: From Pixels and Instructions to Robot Actions

VLA (Vision Language Action Models)

Machine Learning

May 17, 2026 45 min read 436

DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models

MoE architecture for efficient LLM scaling via specialized experts

Machine LearningLLMsTransformers

May 17, 2026 45 min read 385

Maximum Likelihood Reinforcement Learning (MaxRL): A Compute-Indexed Bridge from RL to Log-Likelihood

RL framework that approximates maximum likelihood for binary-outcome tasks.

Machine LearningReinforcement Learning

May 17, 2026 45 min read 231

Reinforcement Learning for Large Language Models: Group Relative Policy Optimization (GRPO)

GRPO and RL for LLM's

Machine LearningReinforcement LearningLLMs

May 17, 2026 45 min read 333

LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architectures from Pixels

Stable JEPA-based world model that learns and plans from raw pixels.

Machine LearningReinforcement Learning

May 11, 2026 45 min read 434

Recursive Language Models: Scaling LLM Contexts via Symbolic Recursion

Language models that recursively refine or compose intermediate reasoning/representations.

Machine LearningLLMs

May 11, 2026 45 min read 176

Mamba-3: Improved Sequence Modeling using State Space Principles

Machine Learning

May 9, 2026 45 min read 285

Transformers: Attention, Architecture, Training, and Scaling

Transformers

Machine LearningTransformersAttention

May 1, 2026 84 min read 365

Diffusion Models and Flow Matching: From Score-Based Diffusion to Continuous Normalizing Flows

Diffusion and flow-matching

Machine LearningDiffusion

Apr 30, 2026 87 min read 232

LoRA Fine-Tuning: Low-Rank Adaptation of Large Neural Networks

LORA Fine-tuning (Low rank adaption)

Machine LearningLoRA

Apr 29, 2026 78 min read 294

Policy Gradient Methods

policy gradient methods

Machine LearningReinforcement Learning

Apr 26, 2026 45 min read 221