We are seeking a talented Lead Data Engineer to join our dynamic team. This role offers an exciting opportunity to work with cutting-edge AI platforms and cloud infrastructure, driving innovation and efficiency in our operations.

Responsibilities

• Engineer and operate AI platforms, ensuring optimal performance and security for AI workloads.
• Automate and manage deployments, upgrades, and scaling of AI services to meet business needs.
• Administer enterprise use of LLM APIs, including monitoring usage patterns and enforcing security standards.
• Design and maintain AWS infrastructure supporting AI and data platforms.
• Implement infrastructure-as-code and CI/CD pipelines for efficient deployments.
• Collaborate with cross-functional teams to ensure architectural alignment and integrated operations.
• Implement secure configurations and ensure compliance with regulatory requirements.
• Partner with various teams to enable use cases leveraging AI platforms and foundational data infrastructure.

Skills

• 5+ years of experience in data or platform engineering roles.
• Proficiency in Python, Terraform, and other programming languages for data platform development.
• Experience with AWS AI/ML services and infrastructure management.
• Strong communication skills and ability to collaborate with diverse stakeholders.

Preferred Skills

• Familiarity with Dataiku setup and administration.
• Experience with Kubernetes and enterprise observability tooling.
• Understanding of enterprise TCO management and DR/HA architecture.

We are committed to fostering a diverse, equitable, and inclusive workplace where all individuals feel valued and empowered to contribute their unique perspectives.

Once you apply for this position, you may receive a phone call, SMS or email at the time of application from our Virtual AI Recruiter, Alex, to conduct an initial interview.


Horizontal facilitates valuable and productive conversations between you and potential employers. We can assist you in growing your career by partnering you with employers that offer challenging assignments.  For those that join the team, we offer competitive compensation and benefits including medical, dental, vision, and retirement. Check out all we have to offer and how you can become part of the Horizontal Talent Team. The pay range for this role is $68 - $105 per hour. This is not a guarantee of compensation, as final offer amount may vary based on factors including but not limited to experience and geographic location.