airflow.contrib.operators.awsbatch_operator

Module Contents

class airflow.contrib.operators.awsbatch_operator.AWSBatchOperator(job_name, job_definition, job_queue, overrides, array_properties=None, max_retries=4200, aws_conn_id=None, region_name=None, **kwargs)[source]

Bases: airflow.models.BaseOperator

Execute a job on AWS Batch Service

Parameters
ui_color = #c3dae0[source]
client[source]
arn[source]
template_fields = ['job_name', 'overrides'][source]
execute(self, context)[source]
_wait_for_task_ended(self)[source]

Try to use a waiter from the below pull request

If the waiter is not available apply a exponential backoff

  • docs.aws.amazon.com/general/latest/gr/api-retries.html

_check_success_task(self)[source]
get_hook(self)[source]
on_kill(self)[source]