We’re looking for a Lead Data Engineer to help design and deliver modern data solutions that power analytics and AI-driven decision-making across supply chain operations. This onsite opportunity in San Francisco offers the chance to work closely with cross-functional partners on scalable cloud-native data products in a fast-paced, collaborative environment.

Responsibilities

• Design, build, and maintain scalable data pipelines and data products on Google Cloud Platform.
• Develop and optimize enterprise data solutions using Dataproc, BigQuery, SQL, and dbt.
• Create robust data models that support both analytical and operational reporting needs.
• Build efficient ETL/ELT workflows to ingest, transform, and publish data from multiple systems.
• Partner with product managers, architects, analysts, and business stakeholders to translate requirements into technical solutions.
• Lead technical design discussions and participate in code reviews to help maintain engineering quality.
• Improve performance, reliability, scalability, and cost efficiency across cloud-based data platforms.
• Support production operations, including monitoring, testing, issue resolution, and continuous improvement efforts.
• Contribute to reusable engineering standards, frameworks, and documentation.
• Mentor team members and collaborate within Agile delivery teams.

Skills

• 8+ years of experience in data engineering, including technical leadership on enterprise initiatives.
• Strong hands-on experience with Google Cloud Platform.
• Advanced proficiency with Dataproc, BigQuery, SQL, and dbt.
• Solid understanding of modern ETL/ELT architecture and large-scale data processing.
• Experience with dimensional modeling, normalized models, and data warehouse design.
• Ability to design cloud-native pipelines that are scalable and maintainable.
• Experience working with Git, CI/CD pipelines, and engineering best practices.
• Strong troubleshooting, analytical thinking, and problem-solving skills.
• Clear communication skills and the ability to work effectively across teams.

Preferred Skills

• Experience with Apache Airflow for workflow orchestration.
• Exposure to Kafka or other streaming technologies.
• Working knowledge of PySpark for distributed processing.
• Proficiency in Python for automation and data engineering support.
• Familiarity with data quality, metadata management, and governance practices.
• Background in retail, supply chain, transportation, logistics, or warehouse management systems.
• Experience supporting distribution center operations.

Horizontal is committed to building an inclusive workplace where diverse perspectives are valued, respected, and supported. We welcome candidates from all backgrounds and encourage individuals who are passionate about collaboration, innovation, and equitable opportunities to apply.

By applying for this position, you acknowledge and agree that Horizontal Talent may contact you regarding your application using automated technology, including phone calls, SMS/text messages, or email, which may be delivered by our virtual AI recruiter, Alex.