Agentic AI Data Platform Engineer

New York, NY

|

Remote

|

Contract

|Job ID 71238|Posted Aug 5, 2025
JOB DESCRIPTION

We are seeking a talented and innovative Data Platform Engineer to join our dynamic team. This role offers the opportunity to work on cutting-edge projects that drive digital transformation and enhance data-driven decision-making.

Responsibilities

  • Design and implement scalable data ingestion and transformation pipelines to support autonomous AI agents.
  • Collaborate on developing platforms for real-time data quality monitoring and anomaly detection.
  • Maintain agent memory architecture and integrate large language models for enhanced performance.
  • Build and manage APIs and event-driven architectures to facilitate agent communication.
  • Optimize platform performance, focusing on data indexing and latency reduction.
  • Develop tools for platform observability and implement security and governance practices.
  • Support and troubleshoot production issues, ensuring smooth operation of data systems.

Skills

  • 3+ years of experience in data engineering or backend systems.
  • Strong proficiency in Python, SQL, and modern data frameworks.
  • Experience with vector databases and semantic search technologies.
  • Familiarity with cloud platforms such as AWS, GCP, or Azure.
  • Excellent analytical and problem-solving skills.

Preferred Skills

  • Prior experience in multi-agent systems or agent-based simulations.
  • Knowledge of data-centric AI pipelines and retrieval-augmented generation.
  • Exposure to observability tools and practices.
  • Open-source contributions in AI infrastructure or related fields.

 

We are committed to fostering a diverse, equitable, and inclusive environment where all team members are valued and empowered to contribute their unique perspectives.

 

Once you apply for this position, you may receive a phone call, SMS or email at the time of application from our Virtual AI Recruiter, Alex, to conduct an initial interview.

 

Horizontal is proud to be an Equal Opportunity and Affirmative Action Employer. 

We seek to provide employment opportunities to talented, qualified candidates regardless of race, color, sex/gender including gender identity and/or expression, national origin, religion, sexual orientation, disability, marital status, citizen status, veteran status, or any other protected classification under federal, state or local law.

In addition, Horizontal will provide reasonable accommodations for qualified individuals with disabilities. If you need to request a reasonable accommodation in order to complete the application or interview process, please contact us.

All applicants applying must be legally authorized to work in the country of employment.