Senior Data Orchestration Engineer
Minneapolis , Minnesota
|Hybrid
|Contract
Minneapolis, Minnesota
|Hybrid
|Contract
Job ID 76829|Posted Nov 2, 2026
JOB DESCRIPTION
Senior Data Orchestration Engineer (Apache Airflow)
Role Overview
We are seeking an experienced Data Orchestration Engineer to lead the migration from AutoSys to Apache Airflow and establish a modern, scalable enterprise orchestration platform. This role will focus on migrating legacy workloads, automating data pipelines, improving reliability, and standardizing orchestration across our enterprise technology ecosystem.
Key Responsibilities
Role Overview
We are seeking an experienced Data Orchestration Engineer to lead the migration from AutoSys to Apache Airflow and establish a modern, scalable enterprise orchestration platform. This role will focus on migrating legacy workloads, automating data pipelines, improving reliability, and standardizing orchestration across our enterprise technology ecosystem.
Key Responsibilities
Role Overview
We are seeking an experienced Data Orchestration Engineer to lead the migration from AutoSys to Apache Airflow and establish a modern, scalable enterprise orchestration platform. This role will focus on migrating legacy workloads, automating data pipelines, improving reliability, and standardizing orchestration across our enterprise technology ecosystem.
Key Responsibilities
- Lead the migration of enterprise workloads from AutoSys to Apache Airflow, including job discovery, dependency mapping, conversion, testing, and cutover.
- Design, develop, and maintain Apache Airflow DAGs for data pipelines and enterprise workflows.
- Assess existing AutoSys scheduling patterns and identify opportunities to consolidate, simplify, or eliminate legacy jobs.
- Orchestrate workloads across Databricks, Microsoft Fabric, cloud services, APIs, and enterprise applications.
- Establish standards for scheduling, dependencies, retries, error handling, monitoring, and operational recovery.
- Implement CI/CD, version control, and infrastructure-as-code practices for orchestration.
- Partner with data engineering, application development, and platform teams to ensure migration continuity and minimize operational disruption.
- 5+ years of experience in data engineering, platform engineering, or enterprise workload orchestration.
- Hands-on experience with AutoSys and Apache Airflow, including migration of legacy enterprise scheduling workloads to modern orchestration platforms.
- Strong Apache Airflow expertise, including DAG development, operators, sensors, scheduling, and production operations.
- Proficiency in Python, SQL, and REST APIs.
- Experience with cloud platforms (Azure, AWS preferred), Databricks, and modern data architectures.
- Understanding of CI/CD, containerization, observability, and production support.
- Successful migration and retirement of AutoSys workloads with minimal business disruption.
- Reduction in legacy job complexity and manual intervention.
- Improved reliability, observability, and recovery of enterprise workflows.
- Standardized, reusable orchestration patterns that accelerate future development.
Role Overview
We are seeking an experienced Data Orchestration Engineer to lead the migration from AutoSys to Apache Airflow and establish a modern, scalable enterprise orchestration platform. This role will focus on migrating legacy workloads, automating data pipelines, improving reliability, and standardizing orchestration across our enterprise technology ecosystem.
Key Responsibilities
- Lead the migration of enterprise workloads from AutoSys to Apache Airflow, including job discovery, dependency mapping, conversion, testing, and cutover.
- Design, develop, and maintain Apache Airflow DAGs for data pipelines and enterprise workflows.
- Assess existing AutoSys scheduling patterns and identify opportunities to consolidate, simplify, or eliminate legacy jobs.
- Orchestrate workloads across Databricks, Microsoft Fabric, cloud services, APIs, and enterprise applications.
- Establish standards for scheduling, dependencies, retries, error handling, monitoring, and operational recovery.
- Implement CI/CD, version control, and infrastructure-as-code practices for orchestration.
- Partner with data engineering, application development, and platform teams to ensure migration continuity and minimize operational disruption.
- 5+ years of experience in data engineering, platform engineering, or enterprise workload orchestration.
- Hands-on experience with AutoSys and Apache Airflow, including migration of legacy enterprise scheduling workloads to modern orchestration platforms.
- Strong Apache Airflow expertise, including DAG development, operators, sensors, scheduling, and production operations.
- Proficiency in Python, SQL, and REST APIs.
- Experience with cloud platforms (Azure, AWS preferred), Databricks, and modern data architectures.
- Understanding of CI/CD, containerization, observability, and production support.
- Successful migration and retirement of AutoSys workloads with minimal business disruption.
- Reduction in legacy job complexity and manual intervention.
- Improved reliability, observability, and recovery of enterprise workflows.
- Standardized, reusable orchestration patterns that accelerate future development.
Horizontal is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, sexual orientation, and gender identity), national origin, age, disability, veteran status, or any other protected characteristic under applicable law.
Horizontal is committed to taking affirmative action to employ and advance in employment qualified individuals with disabilities and protected veterans. If you are an individual with a disability and require a reasonable accommodation to complete any part of the application process or participate in the interview process, click here to request accommodation assistance.
All applicants applying must be legally authorized to work in the country of employment.
We're sorry!
Applications from candidates outside of our global target markets are currently not accepted through Job Board - but that could change in the future. We will update Job Board if we expand to your market. Do you have other candidate related questions? Contact us today.
We're sorry!
Applications outside of the assigned country are currently not accepted for this job - but that doesn't mean we can't work with you. Visit our Job Board to view the jobs available within your market.
Access denied.
Users logged in to client accounts are unable to access Job Board. If you are interested in viewing and applying for open jobs, please log out of your current account. If you are a hiring manager interested in viewing candidates available to hire, click below to go to Talent Board.