No jobs

Run Dossier

Training run for SD 2.1. Mari

68 metrics · 54,904 train · 367 val

Chart Overlays

Compare this run against its peers

0/105
Add peer runs here to layer their train and val traces onto the current metric charts.
running Aug 6, 13:56 Started 25d 0h ago Python 3.11.7 train_joint.py --config /cluster/home/drothenpiele/models/stable_diffusion_mari/mari/.euler-launches/euler_launch_e1dd0bf8-e798-4e2d-bd61-854419145b01/joint_vkitti.yaml --resume /cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-l2-softinv-tau30-sky01-noise10-2026-08-05-19-04-38-4fff/checkpoint-17
lr 4e-5batch 32epochs 200precision fp16model stable-diffusion-2-1 seed 42wd 0grad accum 1warmup 0.05000ema nograd clip 1
ID 9853999
mari/runs/2026-08-06_13-56-57_c511
Metrics 68/68
camera.train 1
camera_valid_fraction
depth.train 33
diag 20
depth_abs_rel
depth_delta1
depth_edge_smoothness
depth_hf_energy
depth_mae
depth_road_hsmooth
depth_tv
vae_decode_hf_energy
valset_muses_absrel
valset_muses_delta1
valset_muses_delta2
valset_muses_delta3
valset_muses_mae
valset_muses_num_samples
valset_muses_projected_pixels
valset_muses_rmse
valset_muses_rmse_log
valset_muses_silog
valset_muses_sqrel
valset_muses_valid_pixels
loss 12
depth
depth_gradient
depth_head
depth_tv
edge_smoothness
gt_edge_smoothness
head_regularization
multiscale_smoothness
prediction_l2
prediction_nonsky
prediction_sky
smoothness_aux
stat 1
sky_weight_fraction
rgb.train 12
diag 2
image_psnr
image_ssim
loss 8
dehaze
prediction_l2
preserve
total
visibility
visibility_aux
visibility_rank
visibility_tv
stat 2
visibility_mean
visibility_std
sys.train 6
gpu_mem_total_gb
gpu_mem_used_gb
gpu_mem_util_pct
gpu_util_pct
lr
visibility_aux_scale
Legacy 16
data/camera 3
enabled/any/source
fields/emitted
rays/emitted
train 12
timestep 11
histogram/bin 10
00
01
02
03
04
05
06
07
08
09
fraction/last
camera/valid/fraction
val/source/rds/camera/valid/fraction
X-Axis
Y-Scale
Series
Group
Namespace

Camera Valid Fraction

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Depth Abs Rel

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Depth Delta1

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Depth Edge Smoothness

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Depth Hf Energy

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Depth Mae

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Depth Road Hsmooth

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Depth Tv

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Vae Decode Hf Energy

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Valset Muses Absrel

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Valset Muses Delta1

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Valset Muses Delta2

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Valset Muses Delta3

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Valset Muses Mae

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Valset Muses Num Samples

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Valset Muses Projected Pixels

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Valset Muses Rmse

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Valset Muses Rmse Log

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Valset Muses Silog

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Valset Muses Sqrel

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Valset Muses Valid Pixels

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Depth

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Depth Gradient

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Depth Head

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Depth Tv

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Edge Smoothness

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Gt Edge Smoothness

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Head Regularization

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Multiscale Smoothness

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Prediction L2

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Prediction Nonsky

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Prediction Sky

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Smoothness Aux

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Sky Weight Fraction

kind=stat
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Image Psnr

dB kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Image Ssim

kind=diag
V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Dehaze

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Prediction L2

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Preserve

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Total

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Visibility

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Visibility Aux

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Visibility Rank

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Visibility Tv

kind=loss
T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Visibility Mean

kind=stat
T V
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 train (raw)
2026-08-06_13-56-57_c511 val (raw)

Visibility Std

kind=stat
T V
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 train (raw)
2026-08-06_13-56-57_c511 val (raw)

Gpu Mem Total Gb

T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Gpu Mem Used Gb

T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Gpu Mem Util Pct

T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Gpu Util Pct

T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Lr

T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Visibility Aux Scale

T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Data/Camera Enabled Any Source

V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Data/Camera Fields Emitted

V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Data/Camera Rays Emitted

V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

Train/Camera Valid Fraction

T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Train/Timestep Fraction Last

T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Train/Timestep Histogram/Bin 00

T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Train/Timestep Histogram/Bin 01

T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Train/Timestep Histogram/Bin 02

T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Train/Timestep Histogram/Bin 03

T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Train/Timestep Histogram/Bin 04

T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Train/Timestep Histogram/Bin 05

T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Train/Timestep Histogram/Bin 06

T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Train/Timestep Histogram/Bin 07

T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Train/Timestep Histogram/Bin 08

T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Train/Timestep Histogram/Bin 09

T
2026-08-06_13-56-57_c511 train (smoothed)
2026-08-06_13-56-57_c511 train (raw)

Val/Source/Rds/Camera Valid Fraction

V
2026-08-06_13-56-57_c511 val (smoothed)
2026-08-06_13-56-57_c511 val (raw)

No output snapshots found for this run.

Outputs are generated during training and saved to outputs/epoch_N_step_M/ directories.

epoch 18 / step 23779 Checkpoint #4880
8/6/2026, 3:59:48 PM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-l2-softinv-tau30-sky01-noise10-2026-08-06-13-56-57-c511/checkpoint-18
epoch 19 / step 24771 Checkpoint #4881
8/6/2026, 3:59:48 PM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-l2-softinv-tau30-sky01-noise10-2026-08-06-13-56-57-c511/checkpoint-19
epoch 20 / step 25763 Checkpoint #4882
8/6/2026, 3:59:48 PM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-l2-softinv-tau30-sky01-noise10-2026-08-06-13-56-57-c511/checkpoint-20
epoch 21 / step 26755 Checkpoint #4889
8/6/2026, 6:22:36 PM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-l2-softinv-tau30-sky01-noise10-2026-08-06-13-56-57-c511/checkpoint-21
epoch 22 / step 27747 Checkpoint #4890
8/6/2026, 6:22:36 PM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-l2-softinv-tau30-sky01-noise10-2026-08-06-13-56-57-c511/checkpoint-22
epoch 23 / step 28739 Checkpoint #4896
8/7/2026, 9:21:47 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-l2-softinv-tau30-sky01-noise10-2026-08-06-13-56-57-c511/checkpoint-23
epoch 24 / step 29731 Checkpoint #4897
8/7/2026, 9:21:47 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-l2-softinv-tau30-sky01-noise10-2026-08-06-13-56-57-c511/checkpoint-24
epoch 25 / step 30723 Checkpoint #4898
8/7/2026, 9:21:47 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-l2-softinv-tau30-sky01-noise10-2026-08-06-13-56-57-c511/checkpoint-25
epoch 26 / step 31715 Checkpoint #4899
8/7/2026, 9:21:47 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-l2-softinv-tau30-sky01-noise10-2026-08-06-13-56-57-c511/checkpoint-26
epoch 27 / step 32707 Checkpoint #4900
8/7/2026, 9:21:47 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-l2-softinv-tau30-sky01-noise10-2026-08-06-13-56-57-c511/checkpoint-27
epoch 28 / step 33699 Checkpoint #4901
8/7/2026, 9:21:47 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-l2-softinv-tau30-sky01-noise10-2026-08-06-13-56-57-c511/checkpoint-28
epoch 29 / step 34691 Checkpoint #4902
8/7/2026, 9:21:47 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-l2-softinv-tau30-sky01-noise10-2026-08-06-13-56-57-c511/checkpoint-29
epoch 30 / step 35683 Checkpoint #4903
8/7/2026, 9:21:47 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-l2-softinv-tau30-sky01-noise10-2026-08-06-13-56-57-c511/checkpoint-30
epoch 31 / step 36675 Checkpoint #4904
8/7/2026, 9:21:47 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-l2-softinv-tau30-sky01-noise10-2026-08-06-13-56-57-c511/checkpoint-31
Producer launch exports are available. Manage launch-owned exports here for quick reference.
Open Launch

Inherited Launch Exports

These exports are published by the run's producer launch.

Published

The producer launch does not publish any exports yet.

Run-Owned Exports

Publish direct filesystem paths here.

Published

No run-owned exports are published yet.

Raw Artifacts

Run-owned exports are typically direct paths, so there are no captured artifacts to publish from here.

Euler View - ML Experiment Monitor