Senior ETL Data Engine

Role: ETL Data Engineer

Experience: 6+Years

Location: Bangalore

Work Mode: Onsite

Key Responsibilities:

• Collaborate with business users and analysts to understand data requirements and deliver scalable data engineering solutions on AWS.
• Design, develop, and optimize ETL pipelines using AWS Glue, Lambda, EMR, Kinesis and Step Functions to process large volumes of structured and semi-structured data.
• Build and manage data lake and data warehouse solutions on Amazon S3 and Redshift.
• Write, test, and maintain SQL queries, stored procedures, and data transformation logic for efficient data processing.
• Utilize Athena, Redshift Spectrum, and Glue Data Catalog to enable self-service analytics and reporting.
• Implement data ingestion workflows from diverse sources including RDBMS, APIs, and flat files.
• Design scalable data models (Star and Snowflake schemas) and ensure adherence to best practices in data architecture.
• Conduct data profiling, perform root cause analysis, and resolve data quality and performance issues.
• Maintain comprehensive documentation including data dictionaries, data flow diagrams, and field-level mappings.
• Support production data pipelines and provide troubleshooting during outages or failures.
• Monitor and optimize data pipeline performance, cost, and reliability across AWS services.

Required Skills & Qualifications:

• 6+ years of experience in data engineering, ETL development, and data warehousing.
• Strong hands-on experience with AWS data services.
• Proficient in SQL, with experience in relational databases like SQL Server, Oracle, and cloud-native platforms.
• Solid understanding of data modeling techniques (Star/Snowflake schemas).
• Experience in ingesting and transforming data from varied sources including files, APIs, and databases.
• Strong analytical and problem-solving skills with the ability to debug data and performance issues.
• Ability to engage directly with business users and translate requirements into technical solutions.
• Capable of managing multiple projects and priorities in a fast-paced environment.
• Excellent written and verbal communication skills."