Find Jobs Find Talent
Lead Data Engineer
Eden Prairie, MN  |  Remote, Onsite
Contract to Hire Position
It appears that you have already applied to this job.
Applied on January 28, 2023
Job Id #61042 Posted December 30, 2022

Projects the candidate will be working on:                                                                 
  • We are establishing Agile Data Warehouse in cloud and many new AI practices to enable personalization in various capabilities to improve employee experience.
Top Requirements:
  • a. AI/ ML Solution design
  • b. Strong problem solving and troubleshooting skills with the ability to exercise mature judgment.
  • c. MLOps
Team and Team size:
  • 10 – 12 team members
  • 1 PM, 3 Product owners
  • 2 Sprint teams consisting - 1 Scrum Masters and 12 developers
Top Responsibilities:
  • Identify opportunities for Data Engineering and AI to enhance the core product platform, select the best machine learning techniques to the specific business problem and then build the models that solve the problem.
  • Architect and design DW and Analytics solutions and cloud services
  • Own the end-end process, from recognizing the problem to implementing the solution.
  • Establish DataOps principles and best practices
  • Design, develop, implement and maintain scalable ETL processes on Azure Cloud using Azure Synapse
  • implement systems and processes to monitor data quality
  • Ad hoc analyses troubleshooting data-related issues
  • Develop and maintain propriety data warehouse tools
  • Offer technical guidance to internal teams and business partners
  • Work with offshore team, business analysts and other data engineering team members to ensure alignment of requirements, methodologies and best practices
  • Participate in scrum process and deliver stories/features according to the schedule
  • Participate in product support activities as needed by the team
  • Individual contributor and Technical lead for Data Engineering - Data pipelines, Data modelling and Data warehouse
Requirements:
  • Undergraduate degree or equivalent experience.
  • BE/BTech or equivalent experience
  • BE/BTech or equivalent experience in Data engineering
  • Advanced SQL knowledge, capable to write optimized queries for faster data workflows.
  • Proven work experience in Python, SQL, Any RDBMS.
  • Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS
  • Must be extremely well versed with handling large volume data and work using different tools to derive the required solution.
  • To be able to work in a fast-paced agile development environment.
Nice to have
  • 5+ years of hands-on software engineering experience.
  • Strong knowledge of Azure Data Lake, Synapse, ADF, Power BI.
  • Strong knowledge of Data Modelling techniques like Data Vault 2.0
  • Understanding of CI/CD framework is an added advantage.
  • Experience with Git / Azure DevOps
  • Ability to interpret/write custom shell scripts. Python scripting is a plus.
Skills/attributes Preferred
  • Experience with AzureML
  • Expert in Azure Synapse, Azure Container Registry, Azure App services

Horizontal is proud to be an Equal Opportunity and Affirmative Action Employer. We seek to provide employment opportunities to talented, qualified candidates regardless of race, color, sex/gender including gender identity and/or expression, national origin, religion, sexual orientation, disability, marital status, citizen status, veteran status, or any other protected classification under federal, state or local law.

In addition, Horizontal will provide reasonable accommodations for qualified individuals with disabilities. If you need to request a reasonable accommodation in order to complete the application or interview process, please contact hr@horizontal.com.

All applicants applying must be legally authorized to work in the country of employment.

EQUAL OPPORTUNITY EMPLOYMENT SURVEY

What is your gender?

What is your ethnicity?

What is your Veteran / U.S. Military Status?

Do you identify with one or more of the classifications of protected veterans below?

If yes, please indicate by checking the appropriate box below

Do you have a disability?

You are considered to have a disability if you have a physical or mental impairment or medical condition that substantially limits a major life activity, or if you have a history or record of such an impairment or medical condition.

Horizontal is proud to be an Equal Employment Opportunity/Affirmative Action Employer providing a drug-free workplace.

Success!

You have saved your first job! To see all your Saved Jobs, click here. Or continue scrolling through jobs and bookmark openings that catch your eye and apply for those jobs later.

Return to Job Search
Close

We’re sorry!

There are currently no open positions in your location or accepting applications from out of the country

Return to Home
Close
X
Cookies help us improve your website experience.
By using our website, you agree to our use of cookies.
Confirm