Chart Overlays
Compare this run against its peers
Add peer runs here to layer their train and val traces onto the current metric charts.
external assumed crashed Apr 10, 13:26 Started 23d 0h ago Python 3.11.7
src/train.py --config configs/model/novel_metric_fusion_gt_rays.yaml --config configs/model/backbone_dinov2_vitl14.yaml --config configs/data/real_drive_sim_euler_loading.yaml --config configs/training/phase_d_joint_consolidation.yaml --config configs/ablations/structure_concat_only.yaml --init-from /cluster/scratch/drothenpiele/euler_train/unifuse/checkpoints/metric-consolidator-2026-04-09-22-37-24-62bb/checkpoint-epoch-6.ptlr 3e-4batch 2epochs 5precision automodel weather_metric_system wd 1e-4
ID 62910001 Job metric_diffusion_pty Part gpupr.24h Node eu-a65-05 CPU 8 GPU 1
unifuse/runs/2026-04-10_13-26-52_248eMetrics 68/68
depth.train 40
diag 21
consolidation 2
base_vs_prior
delta_vs_prior
final 5
depth_abs_rel
depth_mae
depth_rmse
log_radius_l1
xyz_l1
prior 5
depth_abs_rel
depth_mae
depth_rmse
log_radius_l1
xyz_l1
structure 9
depth_l1
edge_l1
first_nonfinite_step_index
first_nonfinite_timestep
had_nonfinite
mode_is_sampled
mode_is_teacher_forced
sampled_debug_enabled
used_fp32_sampler
loss 14
consolidation 3
low_frequency
structure_align
structure_align_edge
final 4
confidence
depth
log_radius
xyz
prior 2
confidence
log_radius
structure 4
confidence
denoise_mse
depth
edge
no stage 1
total
stat 5
final 1
confidence
prior 1
confidence
structure 3
confidence
pred_finite_fraction
pred_has_nonfinite
rgb.train 5
diag 2
image_mae
image_psnr
loss 2
dehaze
smoothness
stat 1
visibility
sys.train 23
data_mean_depth
data_median_depth
data_valid_fraction
flag_refiner_enabled
flag_structure_enabled
gpu_mem_total_gb
gpu_mem_used_gb
gpu_mem_util_pct
gpu_util_pct
lr
lr.default
lr.geometry_encoder_adapter
lr.geometry_encoder_backbone
lr.structure_expert_context
lr.structure_expert_heads
lr.structure_expert_unet_conv_in
lr.structure_expert_unet_cross_attention
lr.structure_expert_unet_down
lr.structure_expert_unet_mid
lr.structure_expert_unet_out
lr.structure_expert_unet_time
lr.structure_expert_unet_up
ray_source_is_predicted
68 selected
X-Axis
Y-Scale
Series
Group
Namespace
Base Vs Prior
↓ kind=diagstage=consolidation T V
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
2026-04-10_13-26-52_248e val (raw) —
Delta Vs Prior
↓ kind=diagstage=consolidation T V
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
2026-04-10_13-26-52_248e val (raw) —
Depth Abs Rel
↓ kind=diagstage=final V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Depth Mae
↓ meters kind=diagstage=final T V
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
2026-04-10_13-26-52_248e val (raw) —
Depth Rmse
↓ meters kind=diagstage=final V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Log Radius L1
↓ kind=diagstage=final T V
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
2026-04-10_13-26-52_248e val (raw) —
Xyz L1
↓ meters kind=diagstage=final T V
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
2026-04-10_13-26-52_248e val (raw) —
Depth Abs Rel
↓ kind=diagstage=prior V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Depth Mae
↓ meters kind=diagstage=prior T V
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
2026-04-10_13-26-52_248e val (raw) —
Depth Rmse
↓ meters kind=diagstage=prior V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Log Radius L1
↓ kind=diagstage=prior T V
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
2026-04-10_13-26-52_248e val (raw) —
Xyz L1
↓ meters kind=diagstage=prior T V
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
2026-04-10_13-26-52_248e val (raw) —
Depth L1
↓ kind=diagstage=structure T V
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
2026-04-10_13-26-52_248e val (raw) —
Edge L1
↓ kind=diagstage=structure T V
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
2026-04-10_13-26-52_248e val (raw) —
First Nonfinite Step Index
kind=diagstage=structure V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
First Nonfinite Timestep
kind=diagstage=structure V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Had Nonfinite
kind=diagstage=structure V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Mode Is Sampled
kind=diagstage=structure V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Mode Is Teacher Forced
kind=diagstage=structure V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Sampled Debug Enabled
kind=diagstage=structure V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Used Fp32 Sampler
kind=diagstage=structure V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Low Frequency
↓ kind=lossstage=consolidation T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Structure Align
↓ kind=lossstage=consolidation T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Structure Align Edge
↓ kind=lossstage=consolidation T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Confidence
↑ kind=lossstage=final T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Depth
↓ meters kind=lossstage=final T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Log Radius
↓ kind=lossstage=final T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Xyz
↓ meters kind=lossstage=final T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Confidence
↑ kind=lossstage=prior T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Log Radius
↓ kind=lossstage=prior T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Confidence
↑ kind=lossstage=structure T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Denoise Mse
↓ kind=lossstage=structure T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Depth
↓ meters kind=lossstage=structure T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Edge
↓ kind=lossstage=structure T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Total
↓ kind=loss T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Confidence
↑ kind=statstage=final V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Confidence
↑ kind=statstage=prior V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Confidence
↑ kind=statstage=structure T V
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
2026-04-10_13-26-52_248e val (raw) —
Pred Finite Fraction
kind=statstage=structure V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Pred Has Nonfinite
kind=statstage=structure V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Image Mae
↓ kind=diagstage=weather V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Image Psnr
↑ dB kind=diagstage=weather V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Dehaze
↓ kind=lossstage=weather T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Smoothness
↓ kind=lossstage=weather T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Visibility
↑ kind=statstage=weather V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Data Mean Depth
V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Data Median Depth
V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Data Valid Fraction
V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Flag Refiner Enabled
V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Flag Structure Enabled
V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
Gpu Mem Total Gb
T V
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
2026-04-10_13-26-52_248e val (raw) —
Gpu Mem Used Gb
T V
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
2026-04-10_13-26-52_248e val (raw) —
Gpu Mem Util Pct
T V
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
2026-04-10_13-26-52_248e val (raw) —
Gpu Util Pct
T V
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
2026-04-10_13-26-52_248e val (raw) —
Lr
T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Lr.Default
T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Lr.Geometry Encoder Adapter
T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Lr.Geometry Encoder Backbone
T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Lr.Structure Expert Context
T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Lr.Structure Expert Heads
T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Lr.Structure Expert Unet Conv In
T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Lr.Structure Expert Unet Cross Attention
T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Lr.Structure Expert Unet Down
T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Lr.Structure Expert Unet Mid
T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Lr.Structure Expert Unet Out
T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Lr.Structure Expert Unet Time
T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Lr.Structure Expert Unet Up
T
2026-04-10_13-26-52_248e train (smoothed) —
2026-04-10_13-26-52_248e train (raw) —
Ray Source Is Predicted
V
2026-04-10_13-26-52_248e val (smoothed) —
2026-04-10_13-26-52_248e val (raw) —
No output snapshots found for this run.
Outputs are generated during training and saved to outputs/epoch_N_step_M/ directories.
epoch 1 / step 800 Checkpoint #2652
4/10/2026, 12:43:43 PM
/cluster/scratch/drothenpiele/euler_train/unifuse/checkpoints/joint-metric-consolidation-2026-04-10-13-26-52-248e/checkpoint-epoch-1.ptepoch 2 / step 1600 Checkpoint #2654
4/10/2026, 12:43:43 PM
/cluster/scratch/drothenpiele/euler_train/unifuse/checkpoints/joint-metric-consolidation-2026-04-10-13-26-52-248e/checkpoint-epoch-2.ptepoch 3 / step 2400 Checkpoint #2658
4/11/2026, 1:25:19 PM
/cluster/scratch/drothenpiele/euler_train/unifuse/checkpoints/joint-metric-consolidation-2026-04-10-13-26-52-248e/checkpoint-epoch-3.ptepoch 4 / step 3200 Checkpoint #2660
4/11/2026, 1:25:19 PM
/cluster/scratch/drothenpiele/euler_train/unifuse/checkpoints/joint-metric-consolidation-2026-04-10-13-26-52-248e/checkpoint-epoch-4.ptRun-Owned Exports
Publish direct filesystem paths here.
Published
No run-owned exports are published yet.
Raw Artifacts
Run-owned exports are typically direct paths, so there are no captured artifacts to publish from here.