Principal Data Engineer

Job Title: Manager – Data Engineering

Experience: 11+ Years

Team Management: Minimum 1 year managing a Data Engineering team

Job Summary

We are looking for an experienced Manager – Data Engineering to lead the design, development, and optimization of scalable data pipelines and modern data platforms across cloud and on-prem environments. The role involves managing a team of data engineers while ensuring reliable data delivery for analytics and business initiatives.

Key Responsibilities

• Design and maintain end-to-end data pipelines and ETL/ELT workflows.
• Build data ingestion, transformation, and orchestration processes for structured and unstructured data.
• Optimize cloud-based data platforms (AWS / Azure / GCP) for performance and scalability.
• Collaborate with architects, analysts, and stakeholders for consistent data delivery.
• Ensure data quality, governance, and monitoring across pipelines.
• Implement CI/CD practices for data engineering workflows.
• Lead and mentor a team of Data Engineers.

Required Skills

• 11+ years of IT experience with strong Data Engineering expertise.
• Strong programming skills in Python and SQL.
• Experience with ETL tools such as Spark, Dataflow, AWS Glue, or Azure Data Factory.
• Hands-on experience with cloud data platforms (AWS / GCP / Azure).
• Knowledge of Apache Spark, Airflow, Data Lakes, Data Warehouses, and streaming tools like Kafka or Pub/Sub.
• Familiarity with DevOps tools such as Git and Jenkins.