Senior Technical Lead (Data Engineering)

Senior Technical Lead (Data Engineering)

Company Overview

Innodata Lanka is a global leader in data engineering and AI-ready solutions. Operating out of Colombo, the team focuses on solving complex engineering challenges by building high-volume data systems that power digital transformation for major global enterprises.

Role Summary

The Senior Technical Lead (Data Engineering) is a pivotal role dedicated to designing and building scalable data platforms. This position is designed for an experienced engineer who thrives in high-volume environments, balancing the creation of robust batch processing systems with responsive real-time data solutions.

Key Responsibilities

• Data Architecture: Design and build scalable data pipelines and platforms capable of handling massive data volumes.

• System Optimization: Build and optimize both batch and real-time data processing solutions to ensure maximum efficiency.

• Workflow Management: Maintain and improve the performance, reliability, and efficiency across all data workflows.

• Engineering Excellence: Solve complex engineering challenges related to distributed systems and high-volume data processing.

Qualifications & Skills

Experience & Education

• 5–8+ years of professional experience in Data Engineering or Backend Engineering.

• Proven track record of building and maintaining distributed data processing systems.

Technical Proficiencies

• Programming: Strong programming skills in Python, Java, or Scala.

• Event Streaming: Hands-on experience with Apache Kafka for event streaming and processing.

• Orchestration: Strong experience with Kubernetes for container orchestration and scaling.

• Data Workflows: Solid understanding of ETL/ELT pipelines and modern data workflows.

• Database Management: Proficiency in SQL and sophisticated data modeling.

• Cloud Platforms: Experience working with major cloud providers such as AWS, Azure, or GCP.

Company: Innodata Lanka

Location: Colombo, Sri Lanka

More Vacancies