AWS CDK Data Engineer, S3, Glue, Lambda, and Redshift

Role : AWS CDK Data Engineer, S3, Glue, Lambda, and Redshift

Location: Toronto

Hybrid

We are seeking an experienced AWS Cloud Data Engineer to join our team in Toronto. As a Cloud Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data pipelines on the AWS cloud platform. You will work with various AWS data services, including S3, Glue, Lambda, Redshift, and more, to ensure the efficient and secure processing of complex data from multiple sources.

Key Requirement:

• 10+ years of experience in Data Engineering with AWS services
• Design and implement data pipelines: Build scalable and efficient data pipelines using AWS services like S3, Glue, Lambda, and Redshift.
• Work with large volumes of complex data: Strong experience in handling data from multiple sources, performing data cleaning and cleansing, and ensuring data quality.
• Develop Streaming Solution - Experience in handling Kafka messages (JASON, CSV message) using Nodejs
• Develop ETL solutions: Expert in utilizing Python programming skills and AWS services like Glue, Lambda, and Redshift to develop ETL solutions.
• Deploy AWS components: Expert in using AWS CDK to deploy using TypeScript and manage AWS components.
• Orchestrate workflows: Strong experience in using AWS Step Functions and Airflow to orchestrate workflows and ensure seamless data processing.
• Work with various data formats: Experience with data formats like CSV, Excel, Parquet, Avro, and more.
• Ensure data security: Implement data encryption, masking, and encoding/decoding techniques to ensure data security.