Chart Overlays
Compare this run against its peers
Add peer runs here to layer their train and val traces onto the current metric charts.
crashed Sep 9, 14:16 Duration: 1h 23m Python 3.11.7
train_joint.py --config /cluster/home/drothenpiele/models/stable_diffusion_mari/mari/.euler-launches/euler_launch_731855cd-5a4a-46ec-a435-991a682351cb/joint_vkitti.yamllr 4e-5batch 24epochs 200precision fp16model stable-diffusion-2-1 seed 42wd 0grad accum 1warmup 0.1000ema nograd clip 1
ID 13502728
mari/runs/2026-09-09_14-16-35_7b1a Error
RuntimeError: Input type (c10::Half) and bias type (float) should be the same
Metrics 49/49
depth.train 10
depth
depth_gradient
depth_head
depth_tv
edge_smoothness
gt_edge_smoothness
head_regularization
multiscale_smoothness
prediction_l2
smoothness_aux
rgb.train 10
loss 8
dehaze
prediction_l2
preserve
total
visibility
visibility_aux
visibility_rank
visibility_tv
stat 2
visibility_mean
visibility_std
segmentation.train 8
loss 7
bce
dice
direct
head_total
prediction_l2
sdf
total
stat 1
sdf_mean
sys.train 6
gpu_mem_total_gb
gpu_mem_used_gb
gpu_mem_util_pct
gpu_util_pct
lr
visibility_aux_scale
Legacy 15
data/camera 3
enabled/any/source
fields/emitted
rays/emitted
train 12
timestep 11
histogram/bin 10
00
01
02
03
04
05
06
07
08
09
fraction/last
camera/valid/fraction
49 selected
X-Axis
Y-Scale
Series
Group
Namespace
Depth
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Depth Gradient
kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Depth Head
kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Depth Tv
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Edge Smoothness
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Gt Edge Smoothness
kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Head Regularization
kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Multiscale Smoothness
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Prediction L2
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Smoothness Aux
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Dehaze
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Prediction L2
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Preserve
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Total
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Visibility
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Visibility Aux
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Visibility Rank
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Visibility Tv
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Visibility Mean
kind=stat T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Visibility Std
kind=stat T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Bce
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Dice
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Direct
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Head Total
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Prediction L2
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Sdf
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Total
↓ kind=loss T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Sdf Mean
kind=stat T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Gpu Mem Total Gb
T V
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a val (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
2026-09-09_14-16-35_7b1a val (raw) —
Gpu Mem Used Gb
T V
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a val (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
2026-09-09_14-16-35_7b1a val (raw) —
Gpu Mem Util Pct
T V
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a val (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
2026-09-09_14-16-35_7b1a val (raw) —
Gpu Util Pct
T V
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a val (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
2026-09-09_14-16-35_7b1a val (raw) —
Lr
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Visibility Aux Scale
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Data/Camera Enabled Any Source
V
2026-09-09_14-16-35_7b1a val (smoothed) —
2026-09-09_14-16-35_7b1a val (raw) —
Data/Camera Fields Emitted
V
2026-09-09_14-16-35_7b1a val (smoothed) —
2026-09-09_14-16-35_7b1a val (raw) —
Data/Camera Rays Emitted
V
2026-09-09_14-16-35_7b1a val (smoothed) —
2026-09-09_14-16-35_7b1a val (raw) —
Train/Camera Valid Fraction
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Train/Timestep Fraction Last
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Train/Timestep Histogram/Bin 00
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Train/Timestep Histogram/Bin 01
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Train/Timestep Histogram/Bin 02
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Train/Timestep Histogram/Bin 03
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Train/Timestep Histogram/Bin 04
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Train/Timestep Histogram/Bin 05
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Train/Timestep Histogram/Bin 06
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Train/Timestep Histogram/Bin 07
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Train/Timestep Histogram/Bin 08
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
Train/Timestep Histogram/Bin 09
T
2026-09-09_14-16-35_7b1a train (smoothed) —
2026-09-09_14-16-35_7b1a train (raw) —
No output snapshots found for this run.
Outputs are generated during training and saved to outputs/epoch_N_step_M/ directories.
Producer launch exports are available. Manage launch-owned exports here for quick reference.
Open LaunchInherited Launch Exports
These exports are published by the run's producer launch.
Published
The producer launch does not publish any exports yet.
Run-Owned Exports
Publish direct filesystem paths here.
Published
No run-owned exports are published yet.
Raw Artifacts
Run-owned exports are typically direct paths, so there are no captured artifacts to publish from here.