Runner#

class Runner[source]#

Bases: object

A method for running a Pipeline.

This can be subclassed to provide the ability to run on different cloud providers, etc.

__init__()#

Methods

__init__()

get_split_ind()

Get the split_ind for the process.

run(cfg_json_uri, pipeline, commands[, ...])

Run commands in a Pipeline using a serialized PipelineConfig.

run_command(cmd)

Run a single command.

get_split_ind() Optional[int][source]#

Get the split_ind for the process.

For split commands, the split_ind determines which split of work to perform within the current OS process. The CLI has a –split-ind option, but some runners may have their own means of communicating the split_ind, and this method should be overridden in such cases. If this method returns None, then the –split-ind option will be used. If both are null, then it won’t be possible to run the command.

Return type

Optional[int]

abstract run(cfg_json_uri: str, pipeline: Pipeline, commands: List[str], num_splits: int = 1, pipeline_run_name: str = 'raster-vision')[source]#

Run commands in a Pipeline using a serialized PipelineConfig.

Parameters
  • cfg_json_uri (str) – URI of a JSON file with a serialized PipelineConfig

  • pipeline (Pipeline) – the Pipeline to run

  • commands (List[str]) – names of commands to run

  • num_splits (int) – number of splits to use for splittable commands

  • pipeline_run_name (str) –

abstract run_command(cmd: List[str])[source]#

Run a single command.

Parameters

cmd (List[str]) – The command to run.