Train: Optimised single_pass — soft-inverse τ30 + L2 + sky0.1 area-pooled + 10% zero-SNR (C3) 914fa85c
Supersedes config 96 (C2) for a cold-start soft-inverse-depth experiment on model “SD 2.1. Mari”. Primary changes: 1. Uses model.depth_mode=metric_soft_inverse with one global tau=30 m. The forward mapping is y=(d−tau)/(d+tau), so near depth is low and far depth approaches +1. 2. Uses a single L2 diffusion-prediction loss from epoch 0; removes the C2 L2/Charbonnier ramp. 3. Samples the zero-terminal-SNR endpoint for 10% of examples and samples the remaining 90% uniformly from first through penultimate timestep. 4. Supervises finite sky targets at 700 m with weight 0.1 and area-pools depth supervision weights. 5. Sets the model decode/evaluation/export cap to 700 m, the shared dataset validity minimum to 2.5 m, and the general validity maximum to 700 m. Soft inverse intentionally has no normalization_min_depth_m; 2.5 m is only a dataset validity cutoff. 6. Enables explicit mask-aware depth resizing. VKITTI2 remains a necessary source-specific exception at valid_max_depth_m=650 m because its 16-bit-centimetre sky sentinel is 655.35 m. Raising that validity threshold to 700 m without a semantic sky mask would classify the sentinel as ordinary valid depth and defeat sky supervision. The finite sky target and model cap remain 700 m. RDS and MUSES use the shared 2.5–700 m validity interval. Euler’s RDS metadata reports a raw 0–1000 m range, so RDS samples above 700 m intentionally enter the far/sky fallback and receive the finite 700 m target. This successor does not resume a metric-log checkpoint; the inherited launch script starts train_joint.py without --resume, avoiding representation reinterpretation.
Output
Failure Metadata
failedContext JSON
{
"reason": null,
"exitCode": 1,
"remotePid": 953339,
"computePid": null,
"allocationJobId": 9753905
}Datasets
14clear_root_rds/cluster/work/igp_psr/drothenpiele/data/rds/rgb.zip/depth_root_rds/cluster/work/igp_psr/drothenpiele/data/rds/depth.zip/intrinsics_root_rds/cluster/work/igp_psr/drothenpiele/data/rds/calibration.zip/train_hazy_root_rds/cluster/work/igp_psr/drothenpiele/data/rds/gloomy_fixed/foggy_rgb.zip/val_hazy_root_rds/cluster/work/igp_psr/drothenpiele/data/rds/gloomy_fixed/foggy_rgb.zip/clear_root_vkitti2/cluster/work/igp_psr/drothenpiele/data/vkitti_2.0.3_rgb.zipdepth_root_vkitti2/cluster/work/igp_psr/drothenpiele/data/vkitti_2.0.3_depth.zipintrinsics_root_vkitti2/cluster/work/igp_psr/drothenpiele/data/vkitti_2.0.3_textgt.zip/train_hazy_vkitti/cluster/work/igp_psr/drothenpiele/data/vkitti_next/gpu_2/foggy_rgb.zip/val_hazy_vkitti/cluster/work/igp_psr/drothenpiele/data/vkitti_next/gpu_2/foggy_rgb.zip/muses_rgb/cluster/work/igp_psr/drothenpiele/data/muses/frame_camera_trainvaltest.zip/muses_sparse_depth/cluster/work/igp_psr/drothenpiele/data/muses/lidar_trainvaltest.zip/muses_intrinsics/cluster/work/igp_psr/drothenpiele/data/muses/frame_camera_trainvaltest.zip/muses_extrinsics/cluster/work/igp_psr/drothenpiele/data/muses/frame_camera_trainvaltest.zip/Execution Artifacts
2Published Exports
Launch-Owned Exports
These semantic handles are what downstream pipelines should resolve against. Auto-published exports come from config-template metadata captured on this launch.
This launch does not publish any exports yet.
Parameters
275Typed Parameters
clear_root_rds(4)depth_root_rds(5)intrinsics_root_rds(6)train_hazy_root_rds(195)val_hazy_root_rds(196)clear_root_vkitti2(1)depth_root_vkitti2(2)intrinsics_root_vkitti2(12)train_hazy_vkitti(216)val_hazy_vkitti(238)muses_rgb(77)muses_sparse_depth(76)muses_intrinsics(82)muses_extrinsics(81)Simple Parameters
cliptruecropcenterseed42trackerwandbuse_emafalsegpu_typertx_4090:1job_namesd_train_concatnorm_max1norm_min-1run_namejoint-opt-l2-softinv-tau30-sky01-noise10tmp_size10Gadam_8bittruedata_kindreal_drive_simema_decay0.9999ema_dtypefloat32log_every10adam_beta10.9adam_beta20.999batch_size32clear_root4depth_modemetric_soft_inversedepth_root5image_size[384, 768]joint_modesingle_passlog_imagestruenum_epochs200output_dir/cluster/scratch/drothenpiele/SD21/exp_1time_limit2-00:00:00mem_per_cpu8Gnum_workers4adam_epsilon1e-8adam_foreachfalseaspect_ratio[1, 2]camera_modelpinholeconditioningconcatlambda_depth1lambda_point0.0min_lr_ratio0.01project_namejoint-dehazinguse_geometryfalsewarmup_ratio0.05weight_decay0cpus_per_task8lambda_camera0.0lambda_dehaze1lambda_eg_ssi0.0learning_rate0.00004max_grad_norm1val_hazy_root104camera_enabledtruefreeze_encoderfalselog_visibilitytruenum_log_images4use_depth_headtrueval_batch_size10camera_fallbackinvaliddepth_head_typebase_residualenable_xformerstrueeuler_train_dir/cluster/work/igp_psr/drothenpiele/data/out/train/sd21-jointlambda_depth_tv0.0002mixed_precisionfp16prediction_typev_predictionsource_kind_rdsreal_drive_simtrain_hazy_root103visibility_cmapviridiscamera_embeddingsinecamera_emit_raysfalsecamera_mlp_ratio4camera_num_heads4camera_token_dim256depth_noise_typeannealed_multireslambda_log_depth0.0lr_schedule_typecosine_with_warmupmin_max_quantile0.02no_decay_enabledfalsepretrained_modelsd2-community/stable-diffusion-2-1camera_num_layers2camera_num_tokens4conv_in_init_modejoint_marigoldgeometry_lambda_z0.15geometry_timestep0joint_weight_psnr1joint_weight_ssim10lambda_depth_head0.2lambda_lambda_mse0.0lambda_visibility0.05sampling_strategysource_balancedsource_weight_rds1valid_max_depth_m700valid_min_depth_m2.5depth_ensemble_tol0.001lambda_uncertainty0.0model_depth_outputvae_decodeval_every_n_epochs1camera_feature_poolavgdepth_ensemble_size1geometry_lambda_phi1num_inference_steps25rds_val_max_samples128sampling_epoch_sizeallsave_every_n_epochs1source_kind_vkitti2vkitti2use_visibility_headtruewarmup_start_factor0.001camera_metadata_rootnullconv_in_target_scale0.7071external_camera_modenonegeometry_loss_robustcharbonnierlambda_vae_depth_rec0.0lambda_visibility_tv0.005sky_depth_override_m700camera_branch_enabledtruecamera_embedding_sizelatentdepth_gradient_robustcharbonnierdepth_multires_levels4encoder_learning_rate0.000007geometry_head_enabledfalsegeometry_lambda_theta1lambda_depth_gradient0.05lambda_geometry_total0.0source_weight_vkitti21use_cross_task_fusiontruevae_decoder_trainablefalsevisibility_rank_pairs128weight_decay_backbone0weight_decay_no_decay0zero_grad_set_to_nonetruecamera_feature_sourcesautocamera_metadata_formateuler_loadingdepth_ensemble_max_res1024depth_smoothness_spacelatent_x0freeze_cross_attentiontruegradient_checkpointingtrueinference_depth_outputvae_decodelambda_geo_consistency0.0lambda_visibility_rank0use_task_skip_adaptersfalsevisibility_rank_margin0.05camera_embedding_stride8camera_prediction_spaceresidual_intrinsicsdepth_ensemble_max_iter2depth_multires_strength0.9depth_smoothness_scales4geometric_pairs_enabledfalsejoint_noise_correlation0joint_weight_delta1_pct0.5keep_last_n_checkpoints5mask_aware_depth_resizetruevalidation_depth_outputvae_decodevisibility_target_gamma4visibility_warmup_steps1000vkitti2_val_max_samples0cross_task_fusion_blocks[0,1,2,3]cross_task_fusion_detachfalsecross_task_fusion_kerneladaptivedepth_ensemble_reductionmediangeometry_camera_encodingsinegeometry_head_num_blocks2joint_weight_abs_rel_pct0.5soft_inverse_depth_tau_m30camera_intrinsics_loadinghierarchicaldepth_diagnostics_enabledtruedepth_head_residual_scale0.05geometry_depth_conventionz_depthgeometry_metric_depth_max700geometry_metric_depth_min2.5normalization_max_depth_m700num_inference_steps_depth20vae_decoder_learning_rate0.000001valid_max_depth_m_vkitti2650visibility_apply_to_depthfalsecamera_residual_logit_clip4depth_head_hidden_channels64depth_resize_interpolationnearestdepth_smoothness_normalizetruedetach_rays_for_point_losstrueenable_efficient_attentiontruelambda_visibility_preserve0.05visibility_apply_to_dehazetruevisibility_apply_to_fusionfalsevisibility_hidden_channels32visibility_target_quantile0.9weight_decay_depth_decoder0weight_decay_geometry_head0camera_require_for_trainingtruecamera_sine_num_frequenciesnullcheckpoint_selection_metricvalset/muses/maecross_task_fusion_dilations[1,2,4]depth_decoder_learning_rate0.00002emit_camera_full_resolutiontruegeometry_eg_ssi_edge_sourcehazygeometry_encoder_input_modehazy_hazygeometry_head_learning_rate0.00004geometry_output_uncertaintytruegeometry_ray_representationunitgradient_accumulation_steps1validation_geometry_enabledfalseweight_decay_dehaze_decoder0camera_output_representationanglescamera_valid_for_approximatefalsecross_task_fusion_directions["rgb_to_depth","depth_to_rgb"]dehaze_decoder_learning_rate0.00002depth_head_context_dilations[1, 2, 4]depth_smoothness_edge_sourcecleardepth_smoothness_edge_weight10geometry_head_residual_scale0.05lambda_depth_edge_smoothness0.002lambda_rgb_depth_consistency0.1weight_decay_geometry_camera0depth_diagnostics_edge_sourcedehazeddepth_diagnostics_edge_weight10depth_head_base_upsample_modebilineargeometry_camera_learning_rate0.00004geometry_head_hidden_channels128geometry_sine_num_frequencies64visibility_decoder_grad_scale1.0camera_approximate_fov_degrees60checkpoint_selection_directionmincross_task_fusion_learned_gatetruegeometry_use_deterministic_vaetruenative_crop_lower_region_ratio0.05depth_multires_downscale_factor2lambda_depth_gt_edge_smoothness0validation_geometry_camera_modepredictedvalidation_geometry_output_modegeometry_headcamera_include_input_in_encodingnullcamera_intrinsics_metadata_scopeintrinsicscross_task_fusion_gate_init_bias0cross_task_fusion_sender_lowpassfalsedepth_head_use_depthwise_contexttruegeometric_pairs_views_per_sample2geometry_condition_on_visibilityfalsegeometry_detach_encoder_featurestruecross_task_fusion_hidden_channels64depth_diagnostics_normalize_depthtruenative_crop_centered_region_ratio0.0native_crop_lower_region_positioncenter_bottomrgb_depth_consistency_edge_weight4rgb_depth_consistency_weight_modehallucinatedgeometric_pairs_emit_pair_metadatatruegeometry_include_input_in_encodingfalselambda_depth_multiscale_smoothness0.001depth_ensemble_regularizer_strength0.02native_crop_centered_region_positioncentercross_task_fusion_attention_kv_tokens1024cross_task_fusion_attention_max_block-1depth_diagnostics_road_edge_threshold0.08geometry_head_detach_camera_embeddingtruedepth_diagnostics_road_bottom_fraction0.4geometry_encoder_no_grad_when_detachedtruecross_task_fusion_sender_lowpass_kernel3depth_diagnostics_high_frequency_kernel5validation_geometry_compute_edge_metricstruevalidation_geometry_compute_point_metricsfalsevalidation_geometry_max_points_per_sample20000validation_geometry_save_geometry_samplestruevalidation_geometry_compute_camera_metricstruevalidation_geometry_compute_resolution_sweepfalsevalidation_geometry_max_point_metric_samples8validation_geometry_save_point_cloud_samplesfalsevalidation_geometry_compute_uncertainty_metricstrueRaw JSON
{
"clip": "true",
"crop": "center",
"seed": 42,
"tracker": "wandb",
"use_ema": "false",
"gpu_type": "rtx_4090:1",
"job_name": "sd_train_concat",
"norm_max": 1,
"norm_min": -1,
"run_name": "joint-opt-l2-softinv-tau30-sky0...