1 pending

Run Dossier

Training run for SD 2.1. Mari

25 metrics · 1,935 train · 7 val

Chart Overlays

Compare this run against its peers

0/118
Add peer runs here to layer their train and val traces onto the current metric charts.
crashed Jul 18, 22:25 Duration: 35m 49s Python 3.11.7 train_joint.py --config /cluster/home/drothenpiele/models/stable_diffusion_mari/mari/.euler-launches/euler_launch_ce97d57a-9289-45a2-9281-af714ce4b6dc/joint_vkitti.yaml
lr 4e-5batch 16epochs 200precision fp16model stable-diffusion-2-1 seed 42wd 0grad accum 1warmup 0.05000ema nograd clip 1
ID 7669321
mari/runs/2026-07-18_22-25-27_2231
Error
BrokenPipeError: [Errno 32] Broken pipe
Metrics 25/25
depth.train 6
depth
depth_head
depth_tv
edge_smoothness
multiscale_smoothness
smoothness_aux
rgb.train 9
loss 7
dehaze
preserve
total
visibility
visibility_aux
visibility_rank
visibility_tv
stat 2
visibility_mean
visibility_std
sys.train 6
gpu_mem_total_gb
gpu_mem_used_gb
gpu_mem_util_pct
gpu_util_pct
lr
visibility_aux_scale
Legacy 4
data/camera 3
enabled/any/source
fields/emitted
rays/emitted
train/camera/valid/fraction
X-Axis
Y-Scale
Series
Group
Namespace

Depth

↓ kind=loss
T
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —

Depth Head

kind=loss
T
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —

Depth Tv

↓ kind=loss
T
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —

Edge Smoothness

↓ kind=loss
T
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —

Multiscale Smoothness

↓ kind=loss
T
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —

Smoothness Aux

↓ kind=loss
T
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —

Dehaze

↓ kind=loss
T
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —

Preserve

↓ kind=loss
T
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —

Total

↓ kind=loss
T
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —

Visibility

↓ kind=loss
T
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —

Visibility Aux

↓ kind=loss
T
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —

Visibility Rank

↓ kind=loss
T
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —

Visibility Tv

↓ kind=loss
T
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —

Visibility Mean

kind=stat
T
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —

Visibility Std

kind=stat
T
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —

Gpu Mem Total Gb

T V
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 val (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —
2026-07-18_22-25-27_2231 val (raw) —

Gpu Mem Used Gb

T V
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 val (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —
2026-07-18_22-25-27_2231 val (raw) —

Gpu Mem Util Pct

T V
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 val (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —
2026-07-18_22-25-27_2231 val (raw) —

Gpu Util Pct

T V
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 val (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —
2026-07-18_22-25-27_2231 val (raw) —

Lr

T
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —

Visibility Aux Scale

T
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —

Data/Camera Enabled Any Source

V
2026-07-18_22-25-27_2231 val (smoothed) —
2026-07-18_22-25-27_2231 val (raw) —

Data/Camera Fields Emitted

V
2026-07-18_22-25-27_2231 val (smoothed) —
2026-07-18_22-25-27_2231 val (raw) —

Data/Camera Rays Emitted

V
2026-07-18_22-25-27_2231 val (smoothed) —
2026-07-18_22-25-27_2231 val (raw) —

Train/Camera Valid Fraction

T
2026-07-18_22-25-27_2231 train (smoothed) —
2026-07-18_22-25-27_2231 train (raw) —

No output snapshots found for this run.

Outputs are generated during training and saved to outputs/epoch_N_step_M/ directories.

Producer launch exports are available. Manage launch-owned exports here for quick reference.
Open Launch

Inherited Launch Exports

These exports are published by the run's producer launch.

Published

The producer launch does not publish any exports yet.

Run-Owned Exports

Publish direct filesystem paths here.

Published

No run-owned exports are published yet.

Raw Artifacts

Run-owned exports are typically direct paths, so there are no captured artifacts to publish from here.

Euler View - ML Experiment Monitor