Find Jobs
Principal Data Engineer
Eden Prairie, Minnesota  |  Remote, Onsite
Contract to Hire Position
It appears that you have already applied to this job.
Applied on October 18, 2021
Job Id #50932 Posted September 27, 2021

Ideal Background:

  • Ideal candidate has used Python to acquire data from a public cloud application API layer and put that data into a multi-cluster Hadoop data lake.


  • Extracting data from an API and ingesting it into Hadoop.
  • Many candidates probably have one or the other.

Top Requirements:

  • 5+ years of Python experience
  • 5+ years of experience with Hadoop
  • 5+ years experience interacting with a public cloud application API layer and extracting data from it

Team and Team size:

  • Core team work hours are 9am-5pm Central.
    Our data engineering team has 6 team members in the US and India and we work with a data management team who also has 6-8 team members.

Top Responsibilities:

  • This person will work user stories that ingest data from various source systems into our Hadoop data lake.
  • The engineer will often need to interact with public cloud application API layers to acquire the data.


  • Experience working with data ingestions from complex API's, databases, and files.
  • Experience working with data transformations using some of the following technologies: Python, Spark, Unix, Sql
  • Experience working data ingestions/transformations parallelly for optimal performance.
  • Experience working in big data environment / big data technologies.
  • Experience working with Jenkins / Git repo .
  • Experience working on an agile team including Scrum or Kanban.

Good to Have Experience:

  • Streamsets TWS (Tivoli work scheduler) Kafka Serverless functions / Kubernetes Nosql

Interview Process:

  • a. How many rounds? 2
  • b. Video vs. phone? MS teams invite, pref Video on
  • c. How technical will the interviews be? Very. Candidates will be asked how they would design something in a certain way and why. And likely also a problem solving question
  • We will have a couple rounds of interviews via MS Teams.
  • Candidates will be asked to solve technical problems live on the interview.

Horizontal is proud to be an Equal Opportunity and Affirmative Action Employer. We seek to provide employment opportunities to talented, qualified candidates regardless of race, color, sex/gender including gender identity and/or expression, national origin, religion, sexual orientation, disability, marital status, citizen status, veteran status, or any other protected classification under federal, state or local law.

In addition, Horizontal will provide reasonable accommodations for qualified individuals with disabilities. If you need to request a reasonable accommodation in order to complete the application or interview process, please contact

All applicants applying must be legally authorized to work in the country of employment.

Upload Your Resume

We accept .DOC, .DOCX, .PDF up to 10 MB.

We do not accept scanned documents, images, or resumes containing images and/or icons.

Password must contain:
  • minimum 10 characters

  • 1 uppercase letter

  • 1 lowercase letter

  • 1 numeric character

  • 1 special character (such as !, %, @, #)

  • Passwords match


What is your gender?

What is your ethnicity?

What is your Veteran / U.S. Military Status?

Do you identify with one or more of the classifications of protected veterans below?

If yes, please indicate by checking the appropriate box below

Do you have a disability?

You are considered to have a disability if you have a physical or mental impairment or medical condition that substantially limits a major life activity, or if you have a history or record of such an impairment or medical condition.

Horizontal is proud to be an Equal Employment Opportunity/Affirmative Action Employer providing a drug-free workplace.


You have saved your first job! To see all your Saved Jobs, click here. Or continue scrolling through jobs and bookmark openings that catch your eye and apply for those jobs later.

Return to Job Search

We’re sorry!

There are currently no open positions in your location or accepting applications from out of the country

Return to Home
Cookies help us improve your website experience.
By using our website, you agree to our use of cookies.