No jobs

Run Dossier

Training run for SD 2.1. Mari

44 metrics · 6,026 train · 9 val

Chart Overlays

Compare this run against its peers

0/105
Add peer runs here to layer their train and val traces onto the current metric charts.
crashed Jul 28, 12:44 Duration: 1h 7m Python 3.11.7 train_joint.py --config /cluster/home/drothenpiele/models/stable_diffusion_mari/mari/.euler-launches/euler_launch_9ed518c3-9148-44a4-bb3c-559d45f30954/joint_vkitti.yaml
lr 4e-5batch 16epochs 200precision fp16model stable-diffusion-2-1 seed 42wd 0grad accum 1warmup 0.05000ema nograd clip 1
ID 8854659
mari/runs/2026-07-28_12-44-05_7562
Error
ValueError: metric 'valset_muses_benchmark/all/absrel' must match [a-z0-9_]+
Metrics 44/44
depth.train 13
loss 12
depth
depth_gradient
depth_head
depth_tv
edge_smoothness
gt_edge_smoothness
head_regularization
multiscale_smoothness
prediction_l2
prediction_nonsky
prediction_sky
smoothness_aux
stat 1
sky_weight_fraction
rgb.train 10
loss 8
dehaze
prediction_l2
preserve
total
visibility
visibility_aux
visibility_rank
visibility_tv
stat 2
visibility_mean
visibility_std
sys.train 6
gpu_mem_total_gb
gpu_mem_used_gb
gpu_mem_util_pct
gpu_util_pct
lr
visibility_aux_scale
Legacy 15
data/camera 3
enabled/any/source
fields/emitted
rays/emitted
train 12
timestep 11
histogram/bin 10
00
01
02
03
04
05
06
07
08
09
fraction/last
camera/valid/fraction
X-Axis
Y-Scale
Series
Group
Namespace

Depth

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Depth Gradient

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Depth Head

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Depth Tv

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Edge Smoothness

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Gt Edge Smoothness

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Head Regularization

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Multiscale Smoothness

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Prediction L2

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Prediction Nonsky

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Prediction Sky

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Smoothness Aux

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Sky Weight Fraction

kind=stat
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Dehaze

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Prediction L2

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Preserve

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Total

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Visibility

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Visibility Aux

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Visibility Rank

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Visibility Tv

kind=loss
T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Visibility Mean

kind=stat
T V
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 val (smoothed)
2026-07-28_12-44-05_7562 train (raw)
2026-07-28_12-44-05_7562 val (raw)

Visibility Std

kind=stat
T V
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 val (smoothed)
2026-07-28_12-44-05_7562 train (raw)
2026-07-28_12-44-05_7562 val (raw)

Gpu Mem Total Gb

T V
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 val (smoothed)
2026-07-28_12-44-05_7562 train (raw)
2026-07-28_12-44-05_7562 val (raw)

Gpu Mem Used Gb

T V
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 val (smoothed)
2026-07-28_12-44-05_7562 train (raw)
2026-07-28_12-44-05_7562 val (raw)

Gpu Mem Util Pct

T V
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 val (smoothed)
2026-07-28_12-44-05_7562 train (raw)
2026-07-28_12-44-05_7562 val (raw)

Gpu Util Pct

T V
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 val (smoothed)
2026-07-28_12-44-05_7562 train (raw)
2026-07-28_12-44-05_7562 val (raw)

Lr

T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Visibility Aux Scale

T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Data/Camera Enabled Any Source

V
2026-07-28_12-44-05_7562 val (smoothed)
2026-07-28_12-44-05_7562 val (raw)

Data/Camera Fields Emitted

V
2026-07-28_12-44-05_7562 val (smoothed)
2026-07-28_12-44-05_7562 val (raw)

Data/Camera Rays Emitted

V
2026-07-28_12-44-05_7562 val (smoothed)
2026-07-28_12-44-05_7562 val (raw)

Train/Camera Valid Fraction

T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Train/Timestep Fraction Last

T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Train/Timestep Histogram/Bin 00

T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Train/Timestep Histogram/Bin 01

T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Train/Timestep Histogram/Bin 02

T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Train/Timestep Histogram/Bin 03

T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Train/Timestep Histogram/Bin 04

T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Train/Timestep Histogram/Bin 05

T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Train/Timestep Histogram/Bin 06

T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Train/Timestep Histogram/Bin 07

T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Train/Timestep Histogram/Bin 08

T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

Train/Timestep Histogram/Bin 09

T
2026-07-28_12-44-05_7562 train (smoothed)
2026-07-28_12-44-05_7562 train (raw)

No output snapshots found for this run.

Outputs are generated during training and saved to outputs/epoch_N_step_M/ directories.

Producer launch exports are available. Manage launch-owned exports here for quick reference.
Open Launch

Inherited Launch Exports

These exports are published by the run's producer launch.

Published

The producer launch does not publish any exports yet.

Run-Owned Exports

Publish direct filesystem paths here.

Published

No run-owned exports are published yet.

Raw Artifacts

Run-owned exports are typically direct paths, so there are no captured artifacts to publish from here.

Euler View - ML Experiment Monitor