Note: Clicking on the option with a triangle bullet ▸ next to it will expand/collapse its detailed information.; Type name written in PascalCase typically refer to a NEML2 object type, oftentimes a primitive tensor type.; The 🔗 symbol means that the tensor value can be cross-reference another object. See Model parameters (revisited) for details.; You can always use Ctrl+F or Cmd+F to search the entire page.

Available objects and their input file syntax

Refer to System Documentation for detailed explanation about this system.

SimpleMPIScheduler

Dispatch work to a single device selected based on processor ID in given batch sizes.

batch_sizes List of batch sizes for each device

capacities List of capacities for each device, default to batch_sizes

devices List of devices to dispatch work to

trace_file The file to write the trace to. If not set, tracing will be disabled.

Detailed documentation link

Dispatch work to a single device in given batch sizes.

batch_size Number of batches to dispatch at once

capacity Maximum number of batches that can be dispatched simultaneously, default to batch_size

device Torch device to run on

trace_file The file to write the trace to. If not set, tracing will be disabled.

Detailed documentation link

Dispatch work to multiple devices based on provided batch sizes and priorities.

batch_sizes List of batch sizes for each device

capacities List of capacities for each device, default to batch_sizes

devices List of devices to dispatch work to

priorities List of priorities for each device

trace_file The file to write the trace to. If not set, tracing will be disabled.

Detailed documentation link