Euler View
1 pending

Run Dossier

Training run for SD 2.1. Mari

22 metrics · 26,476 train · 56 val

Chart Overlays

Compare this run against its peers

0/48
Add peer runs here to layer their train and val traces onto the current metric charts.
crashed Apr 22, 20:52 Duration: 14h 56m Python 3.11.7 train_joint.py --config /cluster/home/drothenpiele/models/stable_diffusion_mari/mari/.euler-launches/euler_launch_55782b8b-bcf0-457d-a71f-5c3d76638978/joint_vkitti.yaml
lr 4e-5batch 16epochs 200precision fp16model stable-diffusion-2-1 seed 42wd 0grad accum 1warmup 0.05000ema nograd clip 1
ID 64455826
mari/runs/2026-04-22_20-52-27_0b3a
Error
BrokenPipeError: [Errno 32] Broken pipe
Metrics 22/22
depth.train 5
diag 3
depth_abs_rel
depth_delta1
depth_mae
loss 2
depth
depth_head
rgb.train 11
diag 2
image_psnr
image_ssim
loss 7
dehaze
preserve
total
visibility
visibility_aux
visibility_rank
visibility_tv
stat 2
visibility_mean
visibility_std
sys.train 6
gpu_mem_total_gb
gpu_mem_used_gb
gpu_mem_util_pct
gpu_util_pct
lr
visibility_aux_scale
22 selected
X-Axis
Y-Scale
Series
Group
Namespace

Depth Abs Rel

↓ kind=diag
V
2026-04-22_20-52-27_0b3a val (smoothed) —
2026-04-22_20-52-27_0b3a val (raw) —

Depth Delta1

↑ kind=diag
V
2026-04-22_20-52-27_0b3a val (smoothed) —
2026-04-22_20-52-27_0b3a val (raw) —

Depth Mae

kind=diag
V
2026-04-22_20-52-27_0b3a val (smoothed) —
2026-04-22_20-52-27_0b3a val (raw) —

Depth

↓ kind=loss
T
2026-04-22_20-52-27_0b3a train (smoothed) —
2026-04-22_20-52-27_0b3a train (raw) —

Depth Head

kind=loss
T
2026-04-22_20-52-27_0b3a train (smoothed) —
2026-04-22_20-52-27_0b3a train (raw) —

Image Psnr

↑ dB kind=diag
V
2026-04-22_20-52-27_0b3a val (smoothed) —
2026-04-22_20-52-27_0b3a val (raw) —

Image Ssim

↑ kind=diag
V
2026-04-22_20-52-27_0b3a val (smoothed) —
2026-04-22_20-52-27_0b3a val (raw) —

Dehaze

↓ kind=loss
T
2026-04-22_20-52-27_0b3a train (smoothed) —
2026-04-22_20-52-27_0b3a train (raw) —

Preserve

↓ kind=loss
T
2026-04-22_20-52-27_0b3a train (smoothed) —
2026-04-22_20-52-27_0b3a train (raw) —

Total

↓ kind=loss
T
2026-04-22_20-52-27_0b3a train (smoothed) —
2026-04-22_20-52-27_0b3a train (raw) —

Visibility

↓ kind=loss
T
2026-04-22_20-52-27_0b3a train (smoothed) —
2026-04-22_20-52-27_0b3a train (raw) —

Visibility Aux

↓ kind=loss
T
2026-04-22_20-52-27_0b3a train (smoothed) —
2026-04-22_20-52-27_0b3a train (raw) —

Visibility Rank

↓ kind=loss
T
2026-04-22_20-52-27_0b3a train (smoothed) —
2026-04-22_20-52-27_0b3a train (raw) —

Visibility Tv

↓ kind=loss
T
2026-04-22_20-52-27_0b3a train (smoothed) —
2026-04-22_20-52-27_0b3a train (raw) —

Visibility Mean

kind=stat
T V
2026-04-22_20-52-27_0b3a train (smoothed) —
2026-04-22_20-52-27_0b3a val (smoothed) —
2026-04-22_20-52-27_0b3a train (raw) —
2026-04-22_20-52-27_0b3a val (raw) —

Visibility Std

kind=stat
T V
2026-04-22_20-52-27_0b3a train (smoothed) —
2026-04-22_20-52-27_0b3a val (smoothed) —
2026-04-22_20-52-27_0b3a train (raw) —
2026-04-22_20-52-27_0b3a val (raw) —

Gpu Mem Total Gb

T
2026-04-22_20-52-27_0b3a train (smoothed) —
2026-04-22_20-52-27_0b3a train (raw) —

Gpu Mem Used Gb

T
2026-04-22_20-52-27_0b3a train (smoothed) —
2026-04-22_20-52-27_0b3a train (raw) —

Gpu Mem Util Pct

T
2026-04-22_20-52-27_0b3a train (smoothed) —
2026-04-22_20-52-27_0b3a train (raw) —

Gpu Util Pct

T
2026-04-22_20-52-27_0b3a train (smoothed) —
2026-04-22_20-52-27_0b3a train (raw) —

Lr

T
2026-04-22_20-52-27_0b3a train (smoothed) —
2026-04-22_20-52-27_0b3a train (raw) —

Visibility Aux Scale

T
2026-04-22_20-52-27_0b3a train (smoothed) —
2026-04-22_20-52-27_0b3a train (raw) —

No output snapshots found for this run.

Outputs are generated during training and saved to outputs/epoch_N_step_M/ directories.

epoch 1 / step 2442 Checkpoint #3257
4/23/2026, 9:15:21 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-dehaze-metric-2026-04-22-20-52-27-0b3a/checkpoint-1
epoch 3 / step 4884 Checkpoint #3258
4/23/2026, 9:15:21 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-dehaze-metric-2026-04-22-20-52-27-0b3a/checkpoint-3
epoch 5 / step 7326 Checkpoint #3259
4/23/2026, 9:15:21 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-dehaze-metric-2026-04-22-20-52-27-0b3a/checkpoint-5
epoch 7 / step 9768 Checkpoint #3260
4/23/2026, 9:15:21 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-dehaze-metric-2026-04-22-20-52-27-0b3a/checkpoint-7
epoch 9 / step 12210 Checkpoint #3261
4/23/2026, 9:15:21 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-dehaze-metric-2026-04-22-20-52-27-0b3a/checkpoint-9
epoch 11 / step 14652 Checkpoint #3262
4/23/2026, 9:15:21 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-dehaze-metric-2026-04-22-20-52-27-0b3a/checkpoint-11
epoch 13 / step 17094 Checkpoint #3263
4/23/2026, 9:15:21 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-dehaze-metric-2026-04-22-20-52-27-0b3a/checkpoint-13
epoch 15 / step 19536 Checkpoint #3271
4/23/2026, 9:48:34 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-dehaze-metric-2026-04-22-20-52-27-0b3a/checkpoint-15
Producer launch exports are available. Manage launch-owned exports here for quick reference.
Open Launch

Inherited Launch Exports

These exports are published by the run's producer launch.

Published

The producer launch does not publish any exports yet.

Run-Owned Exports

Publish direct filesystem paths here.

Published

No run-owned exports are published yet.

Raw Artifacts

Run-owned exports are typically direct paths, so there are no captured artifacts to publish from here.

Euler View - ML Experiment Monitor