Distribution Shift Experiment CLI Builder

Target script: experiment.py

Weights Mode

ImageNet weights is the default behavior if no subcommand is provided. Choose a subcommand mode below.

Dataset Configuration

Root directory for the source distribution.
Root directory for the target distribution.
List file for source images.
List file for target images.

Data Perturbations

Artificially shift the target data.

Noise std dev. (0.0=off)
Angle in degrees.
Shear angle.
Fraction of width.
Fraction of height.
Scale (1.0 = none).

Sampling & Test Controls

Controls sample size, run count, and statistical-test settings.

Images per run.
Number of calibration and test runs.
Index for block sampling.
Dataloader batch size.
Input image size (pixels).
Autoencoder latent dimensions.
Significance level (0–1).
Base seed for runs.
0 disables permutation p-values
Significance Preview
Percentile: 95.0th
Do not assume a Gaussian distribution. Gaussian shown for illustrative purposes only. The red line marks the (1 - alpha) * 100 percentile threshold.

Logging Output

Where to write JSON experiment logs (directory must exist).

Directory path; must already exist.
Output JSON filename.
Required: --source_dir, --target_dir, --target_list_path. If custom weights, also --model_weights_path.