Find Jobs Find Talent
Sr Data Engineer
Minneapolis, MN  |  Remote
Contract Position
It appears that you have already applied to this job.
Applied on January 28, 2023
Job Id #61494 Posted January 25, 2023

Projects the candidate will be working on:                                                                 
  • The contractor will be supporting the Clinical Solutions team by filling in on our new platform called OHBI. OHBI is built on Azure and Snowflake.
  • The contractor will be responsible initially for the Snowflake work tied to our ingestion process.
  • If the candidate proves successful on the Snowflake side of things, the contractor may start to do some work on the ADF side of things where they would do the ingestion of the data directly from the source system.
  • There is also a lot of work that we have in our backlog around DevOps and overall environment improvements which also could get assigned, depending on the individual’s skill set.
Ideal Background:
  • Ability to work and understand ELT - concepts and methodologies
  • Data movement within ADF pipelines, scheduling, and administration
  • Setting up alerting and notification
  • Working experience with SQL databases like Oracle, SQL Server and MySQL and ability to code in Python
  • Working experience with various data file format (CSV, Parquet, AVRO, JSON, etc.)
  • Working experience developing and optimizing Azure Data Factory pipelines to move data large amounts of data
  • Working experience ingesting data from Kafka, AWS, Databricks and REST APIs to Snowflake
  • Experience migrating database changes across environments in cloud platforms
  • Knowledge of Hadoop, Spark and other data analytics and warehouse tools
  • Performing root cause analysis of existing models and proposing a solution
  • Experience developing and maintaining configuration and process management tools/scripts
  • Demonstrated experience delivering successful Continuous Integration solutions using Jenkins, Azure DevOps, or other mainstream CI solutions
  • Git experience working with enterprise products delivered in a SaaS/Cloud model
Team and Team size:
  • The current team size is approx. 21 people. The team make up consists of a Product Owner, Scrum Master, Solution Architect, Lead Engineer, 2 Data Architects, 1 Data Analyst and the rest of the team are Data Engineers. The team consists of both onshore and offshore resources.
Top Responsibilities:
  • The team uses the Agile Methodology and works in 2-week sprints and does releases every 2 weeks. The resource selected, will be responsible for the work assigned to them by the Product Owner and Lead Engineer.
  • Tasks include but are not limited to the following:
  • Building Snowflake objects (tables, pipes, streams, tasks) to support the automated loading of data
  • Developing ADF pipelines to move data from enterprise sources (on-prem and cloud) to Snowflake
  • Helping with DevOps work and other backlog work
  • Analyzing user reported issues to determine root cause and proposed solutions
  • Managing cloud infrastructure (Azure, Terraform, Jenkins, Kubernetes, etc.)
  • ELT modeling with DBT
Skills/attributes Required
  • Undergraduate degree or equivalent experience
  • 2-3 years hands on experience with Snowflake, building pipes, streams, Snow SQL
  • 2-3 years of experience with Big Data Technologies to include different types of frameworks, Spark/Scala, Kafka, or Airflow
  • 2 years of experience with Kubernetes
  • 1-2 year of experience with Azure Cloud knowledge
  • 2 years Python scripting
  • 1-2 years Java and Java script
  • 3 years of experience with Agile concepts and working in an Agile environment
  • Strong Team player and contributor
  • Ability to produce high quality work in a short period of time
  • Ability to work remotely and be focused on the job at hand
Skills/attributes Preferred
  • Technical skills, ability to communicate and express themselves during the interview. It is key that contractor be able to mesh with the team.
  • The team is highly skilled, yet very modest and gets a lot of work done in a short amount of time. The business we work for, has a lot of faith and trust in the team so cohesiveness with the existing team is a must!

Horizontal is proud to be an Equal Opportunity and Affirmative Action Employer. We seek to provide employment opportunities to talented, qualified candidates regardless of race, color, sex/gender including gender identity and/or expression, national origin, religion, sexual orientation, disability, marital status, citizen status, veteran status, or any other protected classification under federal, state or local law.

In addition, Horizontal will provide reasonable accommodations for qualified individuals with disabilities. If you need to request a reasonable accommodation in order to complete the application or interview process, please contact hr@horizontal.com.

All applicants applying must be legally authorized to work in the country of employment.

EQUAL OPPORTUNITY EMPLOYMENT SURVEY

What is your gender?

What is your ethnicity?

What is your Veteran / U.S. Military Status?

Do you identify with one or more of the classifications of protected veterans below?

If yes, please indicate by checking the appropriate box below

Do you have a disability?

You are considered to have a disability if you have a physical or mental impairment or medical condition that substantially limits a major life activity, or if you have a history or record of such an impairment or medical condition.

Horizontal is proud to be an Equal Employment Opportunity/Affirmative Action Employer providing a drug-free workplace.

Success!

You have saved your first job! To see all your Saved Jobs, click here. Or continue scrolling through jobs and bookmark openings that catch your eye and apply for those jobs later.

Return to Job Search
Close

We’re sorry!

There are currently no open positions in your location or accepting applications from out of the country

Return to Home
Close
X
Cookies help us improve your website experience.
By using our website, you agree to our use of cookies.
Confirm