Posted on October 30, 2020

Airflow Apache AWS Admin

Inabia


  • Job type: Full-time
  • Hiring From: Remote/Dallas, TX, United States
  • Salary:
  • Category: All Others
  • Database Administration


Minimum 5 years of experience on Apache Airflow in a recent project


Experience with data pipeline and workflow management tools: Airflow


Experience with AWS cloud services: EC2, EMR, RDS, Redshift


Develop guidelines for Airflow clusters and DAG`s. Performance tuning of the
DAG`s and task implementation


Develop DAG data pipeline to on-board and change management of datasets

Experience
with Apache Airflow, including installing, configuring, and monitoring Airflow
cluster


Understanding of airflow rest services and integration of airflow of platform
eco-system


Orchestrating the Airflow/workflow in a hybrid cloud environment


Working SQL knowledge and experience working with relational databases, query
authoring (SQL) as well as working familiarity with a variety of databases.


Experience building and optimizing big data- data pipelines, architectures,
and data sets.

Strong
analytic skills related to working with unstructured datasets.

Build
processes supporting data transformation, data structures, metadata, dependency
and workload management.

Good
project management and organizational skills.


Experience supporting and working with cross-functional teams in a dynamic
environment.

Subscribe to get Incluzion updates