Posted on October 30, 2020
Minimum 5 years of experience on Apache Airflow in a recent project
Experience with data pipeline and workflow management tools: Airflow
Experience with AWS cloud services: EC2, EMR, RDS, Redshift
Develop guidelines for Airflow clusters and DAG`s. Performance tuning of the
DAG`s and task implementation
Develop DAG data pipeline to on-board and change management of datasets
with Apache Airflow, including installing, configuring, and monitoring Airflow
Understanding of airflow rest services and integration of airflow of platform
Orchestrating the Airflow/workflow in a hybrid cloud environment
Working SQL knowledge and experience working with relational databases, query
authoring (SQL) as well as working familiarity with a variety of databases.
Experience building and optimizing big data- data pipelines, architectures,
and data sets.
analytic skills related to working with unstructured datasets.
processes supporting data transformation, data structures, metadata, dependency
and workload management.
project management and organizational skills.
Experience supporting and working with cross-functional teams in a dynamic
Subscribe to get Incluzion updates