1 pending

Run Dossier

Training run for SD 2.1. Mari

49 metrics · 5,601 train · 7 val

Chart Overlays

Compare this run against its peers

0/118
Add peer runs here to layer their train and val traces onto the current metric charts.
crashed Sep 9, 14:16 Duration: 1h 23m Python 3.11.7 train_joint.py --config /cluster/home/drothenpiele/models/stable_diffusion_mari/mari/.euler-launches/euler_launch_731855cd-5a4a-46ec-a435-991a682351cb/joint_vkitti.yaml
lr 4e-5batch 24epochs 200precision fp16model stable-diffusion-2-1 seed 42wd 0grad accum 1warmup 0.1000ema nograd clip 1
ID 13502728
mari/runs/2026-09-09_14-16-35_7b1a
Error
RuntimeError: Input type (c10::Half) and bias type (float) should be the same
Metrics 49/49
depth.train 10
depth
depth_gradient
depth_head
depth_tv
edge_smoothness
gt_edge_smoothness
head_regularization
multiscale_smoothness
prediction_l2
smoothness_aux
rgb.train 10
loss 8
dehaze
prediction_l2
preserve
total
visibility
visibility_aux
visibility_rank
visibility_tv
stat 2
visibility_mean
visibility_std
segmentation.train 8
loss 7
bce
dice
direct
head_total
prediction_l2
sdf
total
stat 1
sdf_mean
sys.train 6
gpu_mem_total_gb
gpu_mem_used_gb
gpu_mem_util_pct
gpu_util_pct
lr
visibility_aux_scale
Legacy 15
data/camera 3
enabled/any/source
fields/emitted
rays/emitted
train 12
timestep 11
histogram/bin 10
00
01
02
03
04
05
06
07
08
09
fraction/last
camera/valid/fraction
X-Axis
Y-Scale
Series
Group
Namespace

Depth

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Depth Gradient

kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Depth Head

kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Depth Tv

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Edge Smoothness

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Gt Edge Smoothness

kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Head Regularization

kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Multiscale Smoothness

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Prediction L2

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Smoothness Aux

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Dehaze

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Prediction L2

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Preserve

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Total

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Visibility

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Visibility Aux

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Visibility Rank

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Visibility Tv

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Visibility Mean

kind=stat
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Visibility Std

kind=stat
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Bce

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Dice

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Direct

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Head Total

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Prediction L2

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Sdf

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Total

↓ kind=loss
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Sdf Mean

kind=stat
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Gpu Mem Total Gb

T V
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a val (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
2026-09-09_14-16-35_7b1a val (raw) —

Gpu Mem Used Gb

T V
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a val (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
2026-09-09_14-16-35_7b1a val (raw) —

Gpu Mem Util Pct

T V
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a val (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
2026-09-09_14-16-35_7b1a val (raw) —

Gpu Util Pct

T V
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a val (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
2026-09-09_14-16-35_7b1a val (raw) —

Lr

T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Visibility Aux Scale

T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Data/Camera Enabled Any Source

V
2026-09-09_14-16-35_7b1a val (smoothed) —
2026-09-09_14-16-35_7b1a val (raw) —

Data/Camera Fields Emitted

V
2026-09-09_14-16-35_7b1a val (smoothed) —
2026-09-09_14-16-35_7b1a val (raw) —

Data/Camera Rays Emitted

V
2026-09-09_14-16-35_7b1a val (smoothed) —
2026-09-09_14-16-35_7b1a val (raw) —

Train/Camera Valid Fraction

T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Train/Timestep Fraction Last

T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Train/Timestep Histogram/Bin 00

T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Train/Timestep Histogram/Bin 01

T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Train/Timestep Histogram/Bin 02

T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Train/Timestep Histogram/Bin 03

T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Train/Timestep Histogram/Bin 04

T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Train/Timestep Histogram/Bin 05

T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Train/Timestep Histogram/Bin 06

T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Train/Timestep Histogram/Bin 07

T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Train/Timestep Histogram/Bin 08

T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

Train/Timestep Histogram/Bin 09

T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —

No output snapshots found for this run.

Outputs are generated during training and saved to outputs/epoch_N_step_M/ directories.

Producer launch exports are available. Manage launch-owned exports here for quick reference.
Open Launch

Inherited Launch Exports

These exports are published by the run's producer launch.

Published

The producer launch does not publish any exports yet.

Run-Owned Exports

Publish direct filesystem paths here.

Published

No run-owned exports are published yet.

Raw Artifacts

Run-owned exports are typically direct paths, so there are no captured artifacts to publish from here.

Euler View - ML Experiment Monitor