Euler View
No jobs

Run Dossier

Training run for SD 2.1. Mari

8 metrics · 5 train · 7 val

Chart Overlays

Compare this run against its peers

0/105
Add peer runs here to layer their train and val traces onto the current metric charts.
crashed Jul 25, 16:58 Duration: 30s Python 3.11.7 train_joint.py --config /cluster/home/drothenpiele/models/stable_diffusion_mari/mari/.euler-launches/euler_launch_0eb8de64-9bfa-424f-b5dc-78a416b36e4a/joint_vkitti.yaml
lr 4e-5batch 24epochs 200precision fp16model stable-diffusion-2-1 seed 42wd 0grad accum 1warmup 0.1000ema nograd clip 1
ID 8572099
mari/runs/2026-07-25_16-58-22_f07c
Error
OutOfMemoryError: CUDA out of memory. Tried to allocate 136.00 MiB. GPU 0 has a total capacity of 23.52 GiB of which 43.75 MiB is free. Including non-PyTorch memory, this process has 23.46 GiB memory ...
Metrics 8/8
sys.train 4
gpu_mem_total_gb
gpu_mem_used_gb
gpu_mem_util_pct
gpu_util_pct
Legacy 4
data/camera 3
enabled/any/source
fields/emitted
rays/emitted
train/camera/valid/fraction
8 selected
X-Axis
Y-Scale
Series

Gpu Mem Total Gb

T V
2026-07-25_16-58-22_f07c train (smoothed) —
2026-07-25_16-58-22_f07c val (smoothed) —
2026-07-25_16-58-22_f07c train (raw) —
2026-07-25_16-58-22_f07c val (raw) —

Gpu Mem Used Gb

T V
2026-07-25_16-58-22_f07c train (smoothed) —
2026-07-25_16-58-22_f07c val (smoothed) —
2026-07-25_16-58-22_f07c train (raw) —
2026-07-25_16-58-22_f07c val (raw) —

Gpu Mem Util Pct

T V
2026-07-25_16-58-22_f07c train (smoothed) —
2026-07-25_16-58-22_f07c val (smoothed) —
2026-07-25_16-58-22_f07c train (raw) —
2026-07-25_16-58-22_f07c val (raw) —

Gpu Util Pct

T V
2026-07-25_16-58-22_f07c train (smoothed) —
2026-07-25_16-58-22_f07c val (smoothed) —
2026-07-25_16-58-22_f07c train (raw) —
2026-07-25_16-58-22_f07c val (raw) —

Data/Camera Enabled Any Source

V
2026-07-25_16-58-22_f07c val (smoothed) —
2026-07-25_16-58-22_f07c val (raw) —

Data/Camera Fields Emitted

V
2026-07-25_16-58-22_f07c val (smoothed) —
2026-07-25_16-58-22_f07c val (raw) —

Data/Camera Rays Emitted

V
2026-07-25_16-58-22_f07c val (smoothed) —
2026-07-25_16-58-22_f07c val (raw) —

Train/Camera Valid Fraction

T
2026-07-25_16-58-22_f07c train (smoothed) —
2026-07-25_16-58-22_f07c train (raw) —

No output snapshots found for this run.

Outputs are generated during training and saved to outputs/epoch_N_step_M/ directories.

Producer launch exports are available. Manage launch-owned exports here for quick reference.
Open Launch

Inherited Launch Exports

These exports are published by the run's producer launch.

Published

The producer launch does not publish any exports yet.

Run-Owned Exports

Publish direct filesystem paths here.

Published

No run-owned exports are published yet.

Raw Artifacts

Run-owned exports are typically direct paths, so there are no captured artifacts to publish from here.

Euler View - ML Experiment Monitor