Euler View
1 pending

Run Dossier

Training run for UniFuse

76 metrics · 33,187 train · 88 val

Chart Overlays

Compare this run against its peers

0/59
Add peer runs here to layer their train and val traces onto the current metric charts.
crashed Apr 13, 10:41 Duration: 5h 50m Python 3.11.7 src/train.py --config configs/model/inverted_joint_metric.yaml --config configs/model/backbone_dinov2_vitl14.yaml --config configs/data/real_drive_sim_euler_loading.yaml --config configs/training/phase_b_joint_structure.yaml --init-from /cluster/scratch/drothenpiele/euler_train/unifuse/checkpoints/geometry-prompt/checkpoint-epoch-2.pt
lr 2e-4batch 4epochs 12precision automodel weather_metric_system wd 1e-4
ID 63209365
unifuse/runs/2026-04-13_10-41-32_2bb6
Error
BrokenPipeError: [Errno 32] Broken pipe
Metrics 76/76
depth.train 49
diag 26
consolidation 1
delta_vs_prior
final 5
depth_abs_rel
depth_mae
depth_rmse
log_radius_l1
xyz_l1
pred 5
depth_abs_rel
depth_mae
depth_rmse
log_radius_l1
xyz_l1
prior 5
depth_abs_rel
depth_mae
depth_rmse
log_radius_l1
xyz_l1
structure 10
depth_l1
edge_l1
eval_ensemble_size
first_nonfinite_step_index
first_nonfinite_timestep
had_nonfinite
mode_is_sampled
mode_is_teacher_forced
sampled_debug_enabled
used_fp32_sampler
loss 18
consolidation 3
low_frequency
structure_align
structure_align_edge
final 4
confidence
depth
log_radius
xyz
pred 1
log_radius
prior 4
aux_metric_probe
aux_metric_probe_confidence
confidence
log_radius
structure 5
confidence
depth
depth_denoise_mse
edge
rgb_denoise_mse
no stage 1
total
stat 5
final 1
confidence
prior 1
confidence
structure 3
confidence
pred_finite_fraction
pred_has_nonfinite
rgb.train 6
diag 2
image_mae
image_psnr
loss 3
clear
confidence
rgb_denoise_mse
stat 1
visibility
sys.train 21
data_mean_depth
data_median_depth
data_valid_fraction
flag_refiner_enabled
flag_structure_enabled
gpu_mem_total_gb
gpu_mem_used_gb
gpu_mem_util_pct
gpu_util_pct
lr
lr.default
lr.default_no_decay
lr.geometry_encoder_adapter
lr.geometry_encoder_adapter_no_decay
lr.joint_structure_expert_heads
lr.joint_structure_expert_heads_no_decay
lr.joint_structure_expert_model
lr.joint_structure_expert_model_no_decay
lr.prompt_encoder
lr.prompt_encoder_no_decay
ray_source_is_predicted
76 selected
X-Axis
Y-Scale
Series
Group
Namespace

Delta Vs Prior

↓ kind=diagstage=consolidation
T V
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —
2026-04-13_10-41-32_2bb6 val (raw) —

Depth Abs Rel

↓ kind=diagstage=final
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Depth Mae

↓ meters kind=diagstage=final
T V
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —
2026-04-13_10-41-32_2bb6 val (raw) —

Depth Rmse

↓ meters kind=diagstage=final
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Log Radius L1

↓ kind=diagstage=final
T V
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —
2026-04-13_10-41-32_2bb6 val (raw) —

Xyz L1

↓ meters kind=diagstage=final
T V
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —
2026-04-13_10-41-32_2bb6 val (raw) —

Depth Abs Rel

↓ kind=diagstage=pred
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Depth Mae

↓ meters kind=diagstage=pred
T V
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —
2026-04-13_10-41-32_2bb6 val (raw) —

Depth Rmse

↓ meters kind=diagstage=pred
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Log Radius L1

↓ kind=diagstage=pred
T V
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —
2026-04-13_10-41-32_2bb6 val (raw) —

Xyz L1

↓ meters kind=diagstage=pred
T V
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —
2026-04-13_10-41-32_2bb6 val (raw) —

Depth Abs Rel

↓ kind=diagstage=prior
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Depth Mae

↓ meters kind=diagstage=prior
T V
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —
2026-04-13_10-41-32_2bb6 val (raw) —

Depth Rmse

↓ meters kind=diagstage=prior
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Log Radius L1

↓ kind=diagstage=prior
T V
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —
2026-04-13_10-41-32_2bb6 val (raw) —

Xyz L1

↓ meters kind=diagstage=prior
T V
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —
2026-04-13_10-41-32_2bb6 val (raw) —

Depth L1

↓ kind=diagstage=structure
T V
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —
2026-04-13_10-41-32_2bb6 val (raw) —

Edge L1

↓ kind=diagstage=structure
T V
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —
2026-04-13_10-41-32_2bb6 val (raw) —

Eval Ensemble Size

kind=diagstage=structure
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

First Nonfinite Step Index

kind=diagstage=structure
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

First Nonfinite Timestep

kind=diagstage=structure
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Had Nonfinite

kind=diagstage=structure
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Mode Is Sampled

kind=diagstage=structure
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Mode Is Teacher Forced

kind=diagstage=structure
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Sampled Debug Enabled

kind=diagstage=structure
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Used Fp32 Sampler

kind=diagstage=structure
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Low Frequency

↓ kind=lossstage=consolidation
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Structure Align

↓ kind=lossstage=consolidation
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Structure Align Edge

↓ kind=lossstage=consolidation
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Confidence

↑ kind=lossstage=final
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Depth

↓ meters kind=lossstage=final
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Log Radius

↓ kind=lossstage=final
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Xyz

↓ meters kind=lossstage=final
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Log Radius

↓ kind=lossstage=pred
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Aux Metric Probe

kind=lossstage=prior
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Aux Metric Probe Confidence

kind=lossstage=prior
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Confidence

↑ kind=lossstage=prior
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Log Radius

↓ kind=lossstage=prior
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Confidence

↑ kind=lossstage=structure
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Depth

↓ meters kind=lossstage=structure
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Depth Denoise Mse

kind=lossstage=structure
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Edge

↓ kind=lossstage=structure
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Rgb Denoise Mse

kind=lossstage=structure
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Total

↓ kind=loss
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Confidence

↑ kind=statstage=final
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Confidence

↑ kind=statstage=prior
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Confidence

↑ kind=statstage=structure
T V
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —
2026-04-13_10-41-32_2bb6 val (raw) —

Pred Finite Fraction

kind=statstage=structure
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Pred Has Nonfinite

kind=statstage=structure
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Image Mae

↓ kind=diagstage=structure
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Image Psnr

↑ dB kind=diagstage=structure
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Clear

kind=lossstage=structure
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Confidence

↑ kind=lossstage=structure
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Rgb Denoise Mse

kind=lossstage=structure
T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Visibility

↑ kind=statstage=weather
V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Data Mean Depth

V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Data Median Depth

V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Data Valid Fraction

V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Flag Refiner Enabled

V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Flag Structure Enabled

V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

Gpu Mem Total Gb

T V
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —
2026-04-13_10-41-32_2bb6 val (raw) —

Gpu Mem Used Gb

T V
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —
2026-04-13_10-41-32_2bb6 val (raw) —

Gpu Mem Util Pct

T V
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —
2026-04-13_10-41-32_2bb6 val (raw) —

Gpu Util Pct

T V
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —
2026-04-13_10-41-32_2bb6 val (raw) —

Lr

T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Lr.Default

T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Lr.Default No Decay

T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Lr.Geometry Encoder Adapter

T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Lr.Geometry Encoder Adapter No Decay

T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Lr.Joint Structure Expert Heads

T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Lr.Joint Structure Expert Heads No Decay

T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Lr.Joint Structure Expert Model

T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Lr.Joint Structure Expert Model No Decay

T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Lr.Prompt Encoder

T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Lr.Prompt Encoder No Decay

T
2026-04-13_10-41-32_2bb6 train (smoothed) —
2026-04-13_10-41-32_2bb6 train (raw) —

Ray Source Is Predicted

V
2026-04-13_10-41-32_2bb6 val (smoothed) —
2026-04-13_10-41-32_2bb6 val (raw) —

No output snapshots found for this run.

Outputs are generated during training and saved to outputs/epoch_N_step_M/ directories.

epoch 1 / step 3000 Checkpoint #2722
4/13/2026, 12:05:09 PM
/cluster/scratch/drothenpiele/euler_train/unifuse/checkpoints/joint-structure-expert-2026-04-13-10-41-32-2bb6/checkpoint-epoch-1.pt
epoch 2 / step 6000 Checkpoint #2752
4/13/2026, 1:52:36 PM
/cluster/scratch/drothenpiele/euler_train/unifuse/checkpoints/joint-structure-expert-2026-04-13-10-41-32-2bb6/checkpoint-epoch-2.pt
Producer launch exports are available. Manage launch-owned exports here for quick reference.
Open Launch

Inherited Launch Exports

These exports are published by the run's producer launch.

Published

The producer launch does not publish any exports yet.

Run-Owned Exports

Publish direct filesystem paths here.

Published

No run-owned exports are published yet.

Raw Artifacts

Run-owned exports are typically direct paths, so there are no captured artifacts to publish from here.

Euler View - ML Experiment Monitor