Training · Live
2026-02-27 · 22:26 UTC

Epoch RL Lab

We train agents to master environments no human has solved. Robotic hands folding origami cranes. Warehouse fleets negotiating deadlocks. Protein chains discovering fold paths in hours.

Latest Release
WareNet-v5
97.8% deadlock clear
GitHub Stars
24.7k
↑ 1.2k this week
Env Steps
847.3T

trillion interactions

Checkpoints
0

open-source policies

Sim-to-Real
0.0%

transfer success rate

Reward Curve
+91.0

flagship agent · last run

Pretrained Policies

Select a domain — benchmark scores included

9 models available
OrigamiNet-v3 - Origami Crane Fold reinforcement learning agent
SOTA

OrigamiNet-v3

Origami Crane Fold

Fold Fidelity94.2
47M params18.4k
dexterouscontact-richfine-motor
GraspCore-xl - Multi-Object Sorting reinforcement learning agent

GraspCore-xl

Multi-Object Sorting

Success Rate88.7
124M params9.2k
pick-placebin-pickingparallel
ChainFold-v2 - Protein Fold Sim reinforcement learning agent
SOTA

ChainFold-v2

Protein Fold Sim

RMSD Score91.5
312M params6.7k
molecularbio-simlong-horizon

Research Output

View all 84 papers →
NeurIPS 2025847 citations

Contact-Rich Dexterous Manipulation via Residual Physics Policies

We introduce a residual policy framework that decomposes contact-rich tasks into physics-guided primitives and learned residuals, achieving 94.2% success on origami fold benchmarks.

manipulationcontactresidual-RL
Origami Crane — Live Policy - reinforcement learning agent in simulation
Manipulation

Origami Crane — Live Policy

94.2%fold fidelity
ICRA 2025612

Multi-Agent Deadlock Resolution at Scale: 10,000-Robot Warehouses

WareNet-v5 resolves deadlocks in warehouse fleets of up to 10,000 robots with 97.8% clearance rate, trained entirely in simulation and deployed zero-shot on real hardware.

Science Robotics 20251203

Protein Fold Pathfinding in Hours: RL over Molecular Energy Landscapes

ChainFold-v2 discovers viable protein fold paths 40,000× faster than traditional MD simulations by treating fold discovery as a navigation problem in energy space.

RSS 2025389

Sim-to-Real Transfer Survival: A Systematic Study Across 47 Hardware Platforms

We identify the critical failure modes in sim-to-real transfer and present a domain randomization protocol that achieves 94.7% average success across 47 distinct robot platforms.

Warehouse Fleet Sync - RL agent video simulation
Multi-Agent
Warehouse Fleet Sync10k
Rough Terrain Run - RL agent video simulation
Locomotion
Rough Terrain Run96.1%

Sim-to-Real Transfer

Methodology

Sim-to-Real That Survives Deployment

Most sim-to-real research dies in the lab. Epoch policies ship to production.

01

Adaptive Domain Randomization

Physics parameter sweeps that match real-world variance

We sample friction, mass, actuator latency, and sensor noise from distributions calibrated against 47 hardware platforms. Policies trained this way generalize without any real-world fine-tuning.

94.7%zero-shot transfer rate
02

Residual Physics Integration

Learned corrections on top of analytical models

03

Contact-Aware State Estimation

Real-time proprioception bridging the sim-reality gap

04

Hardware-in-the-Loop Evaluation

Every checkpoint tested on physical hardware before release

Transfer Pipeline
SIMULATIONIsaacGym · MuJoCo847T stepsPOLICYTransformer-PPODomain Rand.Residual PhysicsREALPhysics EngineRL Training LoopDeploy94.7% success47 platforms tested
47Hardware Platforms
<48hFine-tune to Deploy
0-shotTransfer Default
3.2×Sample Efficiency
Open Source · MIT License

Start fine-tuning tonight.

Install the Epoch CLI, browse 312 pretrained checkpoints, and have a fine-tuned policy running on your hardware before midnight.

terminalclick to copy
$pip install epoch-rl
$
epoch list --domain manipulation

# browse checkpoints

$
epoch download origami-net-v3

# pull a policy

$
epoch finetune --env your_env.py

# fine-tune tonight

$
epoch eval --hardware real

# deploy to hardware

Read the docs →

Python 3.9+ · PyTorch 2.0+ · CUDA 11.8+

From the community

OrigamiNet-v3 fine-tuned on our custom gripper in 6 hours. Deployed to production the same day. No other lab ships policies that actually transfer.

KW

Dr. Kenji Watanabe

Robotics Lead · Preferred Networks

WareNet-v5 cleared every deadlock in our 800-robot simulation. We were about to spend 6 months building this ourselves. Epoch saved us a year.

PK

Priya Krishnamurthy

CTO · FluxLogistics

The benchmark scores aren't inflated. ChainFold-v2 hit 91.5% RMSD on our held-out protein set first try. I've never seen a pretrained policy generalize this well.

MD

Marcus Delacroix

PhD Candidate · MIT CSAIL