AWSBatchRunner#
- class AWSBatchRunner[source]#
Bases:
Runner
Runs pipelines remotely using AWS Batch.
Requires Everett configuration of form:
` [AWS_BATCH] cpu_job_queue= cpu_job_def= gpu_job_queue= gpu_job_def= attempts= `
- __init__()#
Methods
__init__
()Get the split_ind for the process.
run
(cfg_json_uri, pipeline, commands[, ...])Run commands in a Pipeline using a serialized PipelineConfig.
- get_split_ind()[source]#
Get the split_ind for the process.
For split commands, the split_ind determines which split of work to perform within the current OS process. The CLI has a –split-ind option, but some runners may have their own means of communicating the split_ind, and this method should be overridden in such cases. If this method returns None, then the –split-ind option will be used. If both are null, then it won’t be possible to run the command.
- run(cfg_json_uri, pipeline, commands, num_splits=1, pipeline_run_name: str = 'raster-vision')[source]#
Run commands in a Pipeline using a serialized PipelineConfig.
- Parameters
cfg_json_uri – URI of a JSON file with a serialized PipelineConfig
pipeline – the Pipeline to run
commands – names of commands to run
num_splits – number of splits to use for splittable commands
pipeline_run_name (str) –