Home/
Search jobs/
Lead Site Reliability Engineer ELK | Kuala Lumpur, W.P. Kuala Lumpur
Lead Site Reliability Engineer ELK
Back to job search
Back to job search

Kuala Lumpur , W.P. Kuala Lumpur

|

Hybrid

|

Direct hire

Kuala Lumpur, W.P. Kuala Lumpur

|

Hybrid

|

Direct hire

Job ID 8349|Posted Aug 3, 2026
JOB DESCRIPTION
Lead Site Reliability Engineer ELK
Kuala Lumpur, Malaysia


 About Horizontal: Established since 2003 in the US, Horizontal solves complex challenges across two distinct businesses: Horizontal Digital and Horizontal Talent. We are consistently recognized for being a top workplace and one of the fastest-growing private companies. Horizontal Talent specializes in staffing for IT, Digital & Creative, and Business & Strategy markets. We have global offices in US, UAE, India, Australia and Malaysia.

Job Summary:

We are seeking a highly experienced Lead Site Reliability Engineer to own and drive the reliability, scalability, and evolution of our enterprise observability platform.
This is not a traditional DevOps, Cloud Engineering, or Kubernetes-focused role. We are specifically looking for an engineer with deep hands-on expertise operating large-scale Elasticsearch, Logstash, Kibana (ELK) and Kafka platforms in mission-critical production environments. The successful candidate will serve as a technical leader, influencing architecture decisions, driving operational excellence, and mentoring engineering teams while remaining actively involved in troubleshooting and platform engineering.
You will work closely with Architecture, Engineering, Security, and Operations teams to ensure our observability and data ingestion platforms remain reliable, scalable, and performant.


Key Responsibilities
ELK Platform Ownership
  • Lead the design, operation, maintenance, and continuous evolution of enterprise-scale Elasticsearch, Logstash, and Kibana platforms.
  • Drive platform architecture, scalability planning, capacity management, and reliability improvements.
  • Manage Elasticsearch cluster health, performance tuning, shard allocation strategies, index lifecycle management, and storage optimization.
  • Plan and execute platform upgrades, migrations, patching activities, and disaster recovery initiatives.
  • Investigate and resolve critical production incidents related to data ingestion, indexing performance, search latency, and cluster stability.
  • Establish operational standards, monitoring frameworks, and best practices for observability platform operations.

Kafka & Data Ingestion Engineering
  • Design, operate, and optimize Kafka-based data ingestion pipelines supporting large-scale enterprise workloads.
  • Troubleshoot data flow issues across Kafka, Logstash, Elasticsearch, and downstream consumers.
  • Manage ingestion performance, throughput optimization, data retention, replay strategies, and platform resilience.
  • Identify and eliminate bottlenecks across distributed ingestion architectures.
  • Ensure end-to-end data reliability, consistency, and availability across production environments.

Technical Leadership
  • Act as a technical authority for observability and platform engineering initiatives.
  • Lead architecture reviews and challenge designs when necessary to ensure operational excellence.
  • Drive technical decision-making through influence, collaboration, and engineering best practices.
  • Partner with cross-functional teams to define scalable and maintainable platform solutions.
  • Mentor engineers and contribute to the growth of technical capabilities across the organization.
  • Simplify and communicate complex technical concepts to both technical and non-technical stakeholders.

Reliability & Operations
  • Lead root cause analysis for complex production incidents and implement sustainable preventive measures.
  • Develop automation, monitoring, self-healing capabilities, and operational tooling.
  • Drive continuous improvement initiatives across reliability, performance, security, and observability.
  • Participate in critical incident response and post-incident reviews.
  • Establish robust operational processes, documentation, and knowledge-sharing practices.

Required Skills & Qualifications
  • Bachelor's Degree in Computer Science, Engineering, Information Technology, or a related discipline.
  • 15+ years of experience in infrastructure engineering, platform engineering, site reliability engineering, or related enterprise technology environments.
  • Demonstrated experience owning and operating large-scale production ELK platforms.
  • Deep expertise in:
    • Elasticsearch
    • Logstash
    • Kibana
    • Kafka
  • Strong understanding of:
    • Distributed systems architecture
    • High-availability platform design
    • Capacity planning
    • Performance tuning
    • Disaster recovery
    • Enterprise observability platforms
  • Proven experience troubleshooting and optimizing large-scale Kafka ingestion pipelines
  • Strong Linux administration and systems engineering knowledge.
  • Experience automating operational processes using scripting and Infrastructure-as-Code practices.
  • Ability to lead technical discussions across Architecture, Engineering, Operations, and Security teams.
  • Excellent analytical, troubleshooting, and communication skills.

Experience
  • 15+ years of overall experience in data engineering, data architecture, or analytics platform roles.
  • 3+ years of experience in a senior or lead capacity, with accountability for architecture decisions and technical delivery.
  • Demonstrated experience leading data engineering teams or acting as the primary technical authority for data platforms.
  • Prior experience supporting banking, financial services, or regulated environments is strongly preferred.
  • Proven track record of working with cloud-based data platforms (Databricks, AWS / Azure / GCP), including production-grade systems.
  • Bachelor’s or Master’s degree in Computer Science, IT, Engineering, or a related technical field.
  • Relevant certifications in cloud platforms, data engineering, or data architecture are an advantage

The above description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.
Horizontal is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, sexual orientation, and gender identity), national origin, age, disability, veteran status, or any other protected characteristic under applicable law.

Horizontal is committed to taking affirmative action to employ and advance in employment qualified individuals with disabilities and protected veterans. If you are an individual with a disability and require a reasonable accommodation to complete any part of the application process or participate in the interview process, click here to request accommodation assistance.

All applicants applying must be legally authorized to work in the country of employment.

We're sorry!

Applications from candidates outside of our global target markets are currently not accepted through Job Board - but that could change in the future. We will update Job Board if we expand to your market. Do you have other candidate related questions? Contact us today.
Contact us
Return to home

We're sorry!

Applications outside of the assigned country are currently not accepted for this job - but that doesn't mean we can't work with you. Visit our Job Board to view the jobs available within your market.
View available jobs
Contact us

Access denied.

Users logged in to client accounts are unable to access Job Board. If you are interested in viewing and applying for open jobs, please log out of your current account. If you are a hiring manager interested in viewing candidates available to hire, click below to go to Talent Board.
Go to Talent Board
Explore Horizontal
Talk to an expert
Expertise
Solutions
Company
Need a digital marketing solution? Visit our partner company Horizontal Digital. (Opens in a new tab)
Privacy Policy | Terms And Conditions | Accessibility | CA Privacy Notice |
©Horizontal Talent 2026
Horizontal Integration is an affirmative action and equal opportunity employer.
| Protect yourself from job scams
Badge
Horizontal is a minority-owned business that is certified by the National Minority Supplier Development Council (NMSDC).