Euler View
No jobs

Run Dossier

Training run for SD 2.1. Mari

64 metrics · 46,445 train · 207 val

Chart Overlays

Compare this run against its peers

0/105
Add peer runs here to layer their train and val traces onto the current metric charts.
external assumed crashed Jul 27, 23:45 Started 34d 15h ago Python 3.11.7 train_joint.py --config /cluster/home/drothenpiele/models/stable_diffusion_mari/mari/.euler-launches/euler_launch_43a0f523-48b5-411a-a80c-ad4ed1904bd3/joint_vkitti.yaml
lr 4e-5batch 16epochs 200precision fp16model stable-diffusion-2-1 seed 42wd 0grad accum 1warmup 0.05000ema nograd clip 1
ID 8729953
mari/runs/2026-07-27_23-45-42_f1ec
Metrics 64/64
camera.train 1
camera_valid_fraction
depth.train 29
diag 19
depth_abs_rel
depth_delta1
depth_edge_smoothness
depth_hf_energy
depth_mae
depth_road_hsmooth
depth_tv
valset_muses_absrel
valset_muses_delta1
valset_muses_delta2
valset_muses_delta3
valset_muses_mae
valset_muses_num_samples
valset_muses_projected_pixels
valset_muses_rmse
valset_muses_rmse_log
valset_muses_silog
valset_muses_sqrel
valset_muses_valid_pixels
loss 10
depth
depth_gradient
depth_head
depth_tv
edge_smoothness
gt_edge_smoothness
head_regularization
multiscale_smoothness
prediction_l2
smoothness_aux
rgb.train 12
diag 2
image_psnr
image_ssim
loss 8
dehaze
prediction_l2
preserve
total
visibility
visibility_aux
visibility_rank
visibility_tv
stat 2
visibility_mean
visibility_std
sys.train 6
gpu_mem_total_gb
gpu_mem_used_gb
gpu_mem_util_pct
gpu_util_pct
lr
visibility_aux_scale
Legacy 16
data/camera 3
enabled/any/source
fields/emitted
rays/emitted
train 12
timestep 11
histogram/bin 10
00
01
02
03
04
05
06
07
08
09
fraction/last
camera/valid/fraction
val/source/rds/camera/valid/fraction
64 selected
X-Axis
Y-Scale
Series
Group
Namespace

Camera Valid Fraction

kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Depth Abs Rel

↓ kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Depth Delta1

↑ kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Depth Edge Smoothness

↓ kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Depth Hf Energy

↓ kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Depth Mae

kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Depth Road Hsmooth

↓ kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Depth Tv

↓ kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Valset Muses Absrel

kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Valset Muses Delta1

kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Valset Muses Delta2

kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Valset Muses Delta3

kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Valset Muses Mae

kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Valset Muses Num Samples

kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Valset Muses Projected Pixels

kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Valset Muses Rmse

kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Valset Muses Rmse Log

kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Valset Muses Silog

kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Valset Muses Sqrel

kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Valset Muses Valid Pixels

kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Depth

↓ kind=loss
T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Depth Gradient

kind=loss
T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Depth Head

kind=loss
T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Depth Tv

↓ kind=loss
T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Edge Smoothness

↓ kind=loss
T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Gt Edge Smoothness

kind=loss
T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Head Regularization

kind=loss
T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Multiscale Smoothness

↓ kind=loss
T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Prediction L2

kind=loss
T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Smoothness Aux

↓ kind=loss
T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Image Psnr

↑ dB kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Image Ssim

↑ kind=diag
V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Dehaze

↓ kind=loss
T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Prediction L2

kind=loss
T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Preserve

↓ kind=loss
T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Total

↓ kind=loss
T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Visibility

↓ kind=loss
T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Visibility Aux

↓ kind=loss
T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Visibility Rank

↓ kind=loss
T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Visibility Tv

↓ kind=loss
T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Visibility Mean

kind=stat
T V
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —
2026-07-27_23-45-42_f1ec val (raw) —

Visibility Std

kind=stat
T V
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —
2026-07-27_23-45-42_f1ec val (raw) —

Gpu Mem Total Gb

T V
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —
2026-07-27_23-45-42_f1ec val (raw) —

Gpu Mem Used Gb

T V
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —
2026-07-27_23-45-42_f1ec val (raw) —

Gpu Mem Util Pct

T V
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —
2026-07-27_23-45-42_f1ec val (raw) —

Gpu Util Pct

T V
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —
2026-07-27_23-45-42_f1ec val (raw) —

Lr

T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Visibility Aux Scale

T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Data/Camera Enabled Any Source

V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Data/Camera Fields Emitted

V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Data/Camera Rays Emitted

V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

Train/Camera Valid Fraction

T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Train/Timestep Fraction Last

T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Train/Timestep Histogram/Bin 00

T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Train/Timestep Histogram/Bin 01

T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Train/Timestep Histogram/Bin 02

T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Train/Timestep Histogram/Bin 03

T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Train/Timestep Histogram/Bin 04

T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Train/Timestep Histogram/Bin 05

T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Train/Timestep Histogram/Bin 06

T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Train/Timestep Histogram/Bin 07

T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Train/Timestep Histogram/Bin 08

T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Train/Timestep Histogram/Bin 09

T
2026-07-27_23-45-42_f1ec train (smoothed) —
2026-07-27_23-45-42_f1ec train (raw) —

Val/Source/Rds/Camera Valid Fraction

V
2026-07-27_23-45-42_f1ec val (smoothed) —
2026-07-27_23-45-42_f1ec val (raw) —

No output snapshots found for this run.

Outputs are generated during training and saved to outputs/epoch_N_step_M/ directories.

epoch 0 / step 1619 Checkpoint #4476
7/28/2026, 6:11:29 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-gate-off-l1-sky-noise-2026-07-27-23-45-42-f1ec/checkpoint-0
epoch 1 / step 3238 Checkpoint #4477
7/28/2026, 6:11:29 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-gate-off-l1-sky-noise-2026-07-27-23-45-42-f1ec/checkpoint-1
epoch 2 / step 4857 Checkpoint #4478
7/28/2026, 6:11:29 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-gate-off-l1-sky-noise-2026-07-27-23-45-42-f1ec/checkpoint-2
epoch 3 / step 6476 Checkpoint #4479
7/28/2026, 6:11:29 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-gate-off-l1-sky-noise-2026-07-27-23-45-42-f1ec/checkpoint-3
epoch 4 / step 8095 Checkpoint #4480
7/28/2026, 6:11:29 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-gate-off-l1-sky-noise-2026-07-27-23-45-42-f1ec/checkpoint-4
epoch 5 / step 9714 Checkpoint #4481
7/28/2026, 6:11:29 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-gate-off-l1-sky-noise-2026-07-27-23-45-42-f1ec/checkpoint-5
epoch 6 / step 11333 Checkpoint #4482
7/28/2026, 6:11:29 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-gate-off-l1-sky-noise-2026-07-27-23-45-42-f1ec/checkpoint-6
epoch 7 / step 12952 Checkpoint #4483
7/28/2026, 6:11:29 AM
/cluster/scratch/drothenpiele/euler_train/mari/checkpoints/joint-opt-gate-off-l1-sky-noise-2026-07-27-23-45-42-f1ec/checkpoint-7
Producer launch exports are available. Manage launch-owned exports here for quick reference.
Open Launch

Inherited Launch Exports

These exports are published by the run's producer launch.

Published

The producer launch does not publish any exports yet.

Run-Owned Exports

Publish direct filesystem paths here.

Published

No run-owned exports are published yet.

Raw Artifacts

Run-owned exports are typically direct paths, so there are no captured artifacts to publish from here.

Euler View - ML Experiment Monitor