Configuration

This page serves as an interactive config generator for the CODES Benchmark. Fill in the fields below to create a custom config.yaml file.


Config Generator

Name of Configuration

Provide a unique identifier for this training run (e.g., "my_run123").

Dataset

Specify which dataset to use, how to transform it, and any additional dataset-related parameters.

Surrogates to Include

Select which surrogate models to train, and specify their training parameters (batch size, epochs). Check the boxes to enable a model, and fill in the corresponding parameters if needed.

Miscellaneous Settings

Configure devices, verbosity, and random seed for reproducibility.

Models to Train (Benchmark Tasks)

Enable and configure different benchmarking scenarios such as interpolation, extrapolation, sparse training data, uncertainty quantification, and batch size scaling.

Interpolation

Extrapolation

Sparse Training Data

Uncertainty Quantification

Batch Size Scaling

Evaluations During Benchmark

Select which evaluations to perform and record during the benchmark.