Senior Data Engineer (Python)

Cloudesign

Full Timesenior

Tamil Nadu, INPosted 6 weeks ago

Resume Keywords to Include

Make sure these keywords appear in your resume to improve ATS scoring

PythonSQLAWSDockerKubernetesTerraformDynamoDBGitSparkAirflowCI/CDMicroservices

Job Description

We are looking for an experienced Senior Data Engineer with 7+ years of expertise in designing, building, and managing large-scale data solutions on AWS. This role requires strong technical leadership, hands-on development skills, and the ability to architect robust data platforms that empower analytics, machine learning, and business intelligence across the organization.

Responsibilities

Lead the design and implementation of scalable data architectures (data lakes, warehouses, and streaming systems).
Build and optimize ETL/ELT pipelines for diverse data sources, ensuring high performance and reliability.
Drive data governance, security, and compliance initiatives across all data platforms.
Mentor junior engineers and provide technical guidance to cross-functional teams.
Collaborate with stakeholders to translate business requirements into technical solutions.
Implement automation and monitoring frameworks to ensure operational excellence. Evaluate and adopt emerging AWS services and modern data engineering tools to enhance capabilities.

Requirements

7+ years of professional experience in data engineering, with at least 4+ years working on AWS.
Deep expertise in AWS services: S3 Glue, Redshift, Athena, EMR, Kinesis, DynamoDB, Lambda, and Step Functions.
Strong proficiency in SQL, Python, and Spark for data processing and pipeline development.
Proven experience with workflow orchestration tools (Airflow, Dagster, Step Functions).
Solid understanding of data modeling, partitioning strategies, and performance tuning.
Hands-on experience with CI/CD pipelines, Git, and Infrastructure-as-Code (Terraform/CloudFormation).
Familiarity with containerization (Docker, Kubernetes) and microservices-based architectures.
Experience in architecting enterprise-scale data platforms.
Exposure to machine learning pipelines and advanced analytics. Strong problem-solving and leadership skills, with the ability to influence technical direction.

This job was posted by Gowripriya P from Cloudesign.