Runner#
- class Runner[source]#
Bases:
object
A method for running a Pipeline.
This can be subclassed to provide the ability to run on different cloud providers, etc.
- __init__()#
Methods
__init__
()Get the split_ind for the process.
run
(cfg_json_uri, pipeline, commands[, ...])Run commands in a Pipeline using a serialized PipelineConfig.
run_command
(cmd)Run a single command.
- get_split_ind() int | None [source]#
Get the split_ind for the process.
For split commands, the split_ind determines which split of work to perform within the current OS process. The CLI has a –split-ind option, but some runners may have their own means of communicating the split_ind, and this method should be overridden in such cases. If this method returns None, then the –split-ind option will be used. If both are null, then it won’t be possible to run the command.
- Return type:
int | None