Chart Overlays
Compare this run against its peers
Add peer runs here to layer their train and val traces onto the current metric charts.
crashed Apr 13, 17:52 Duration: 4h 54m Python 3.11.7
train_joint.py --config /cluster/home/drothenpiele/models/stable_diffusion_mari/mari/.euler-launches/euler_launch_4867cc49-0095-42ef-98a6-503a3448e3df/joint_vkitti.yamllr 3e-5batch 4epochs 200precision fp16model stable-diffusion-2-1 seed 42wd 0grad accum 16warmup 0.05000ema yesgrad clip 1
ID 63209365
mari/runs/2026-04-13_17-52-47_c6db Error
BrokenPipeError: [Errno 32] Broken pipe
Metrics 20/20
depth.train 3
diag 2
depth_abs_rel
depth_delta1
loss 1
depth
rgb.train 11
diag 2
image_psnr
image_ssim
loss 7
dehaze
preserve
total
visibility
visibility_aux
visibility_rank
visibility_tv
stat 2
visibility_mean
visibility_std
sys.train 6
gpu_mem_total_gb
gpu_mem_used_gb
gpu_mem_util_pct
gpu_util_pct
lr
visibility_aux_scale
20 selected
X-Axis
Y-Scale
Series
Group
Namespace
Depth Abs Rel
↓ kind=diag V
2026-04-13_17-52-47_c6db val (smoothed) —
2026-04-13_17-52-47_c6db val (raw) —
Depth Delta1
↑ kind=diag V
2026-04-13_17-52-47_c6db val (smoothed) —
2026-04-13_17-52-47_c6db val (raw) —
Depth
↓ kind=loss T
2026-04-13_17-52-47_c6db train (smoothed) —
2026-04-13_17-52-47_c6db train (raw) —
Image Psnr
↑ dB kind=diag V
2026-04-13_17-52-47_c6db val (smoothed) —
2026-04-13_17-52-47_c6db val (raw) —
Image Ssim
↑ kind=diag V
2026-04-13_17-52-47_c6db val (smoothed) —
2026-04-13_17-52-47_c6db val (raw) —
Dehaze
↓ kind=loss T
2026-04-13_17-52-47_c6db train (smoothed) —
2026-04-13_17-52-47_c6db train (raw) —
Preserve
↓ kind=loss T
2026-04-13_17-52-47_c6db train (smoothed) —
2026-04-13_17-52-47_c6db train (raw) —
Total
↓ kind=loss T
2026-04-13_17-52-47_c6db train (smoothed) —
2026-04-13_17-52-47_c6db train (raw) —
Visibility
↓ kind=loss T
2026-04-13_17-52-47_c6db train (smoothed) —
2026-04-13_17-52-47_c6db train (raw) —
Visibility Aux
↓ kind=loss T
2026-04-13_17-52-47_c6db train (smoothed) —
2026-04-13_17-52-47_c6db train (raw) —
Visibility Rank
↓ kind=loss T
2026-04-13_17-52-47_c6db train (smoothed) —
2026-04-13_17-52-47_c6db train (raw) —
Visibility Tv
↓ kind=loss T
2026-04-13_17-52-47_c6db train (smoothed) —
2026-04-13_17-52-47_c6db train (raw) —
Visibility Mean
kind=stat T V
2026-04-13_17-52-47_c6db train (smoothed) —
2026-04-13_17-52-47_c6db val (smoothed) —
2026-04-13_17-52-47_c6db train (raw) —
2026-04-13_17-52-47_c6db val (raw) —
Visibility Std
kind=stat T V
2026-04-13_17-52-47_c6db train (smoothed) —
2026-04-13_17-52-47_c6db val (smoothed) —
2026-04-13_17-52-47_c6db train (raw) —
2026-04-13_17-52-47_c6db val (raw) —
Gpu Mem Total Gb
T
2026-04-13_17-52-47_c6db train (smoothed) —
2026-04-13_17-52-47_c6db train (raw) —
Gpu Mem Used Gb
T
2026-04-13_17-52-47_c6db train (smoothed) —
2026-04-13_17-52-47_c6db train (raw) —
Gpu Mem Util Pct
T
2026-04-13_17-52-47_c6db train (smoothed) —
2026-04-13_17-52-47_c6db train (raw) —
Gpu Util Pct
T
2026-04-13_17-52-47_c6db train (smoothed) —
2026-04-13_17-52-47_c6db train (raw) —
Lr
T
2026-04-13_17-52-47_c6db train (smoothed) —
2026-04-13_17-52-47_c6db train (raw) —
Visibility Aux Scale
T
2026-04-13_17-52-47_c6db train (smoothed) —
2026-04-13_17-52-47_c6db train (raw) —
No output snapshots found for this run.
Outputs are generated during training and saved to outputs/epoch_N_step_M/ directories.
epoch 1 / step 612 Checkpoint #2756
4/13/2026, 8:00:18 PM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-dehaze-metric-2026-04-13-17-52-47-c6db/checkpoint-1epoch 3 / step 1224 Checkpoint #2758
4/13/2026, 9:09:34 PM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-dehaze-metric-2026-04-13-17-52-47-c6db/checkpoint-3Producer launch exports are available. Manage launch-owned exports here for quick reference.
Open LaunchInherited Launch Exports
These exports are published by the run's producer launch.
Published
The producer launch does not publish any exports yet.
Run-Owned Exports
Publish direct filesystem paths here.
Published
No run-owned exports are published yet.
Raw Artifacts
Run-owned exports are typically direct paths, so there are no captured artifacts to publish from here.