AWS Data Engineer with strong experience in API integrations - 5+ Years - immediate joiners

Job Summary

We are seeking a highly skilled AWS Data Engineer with strong experience in API integrations to join our team. This role involves designing, developing, and maintaining scalable data pipelines and system integrations, and leveraging AWS cloud services. The ideal candidate will have hands-on expertise in AWS-based ETL development, API design and consumption, and integration of best practices to ensure seamless data exchange across diverse applications.

Responsibilities

• Integration Design & Development
• Design, build, and maintain scalable and secure API integrations within the AWS ecosystem.
• Develop data pipelines using AWS services such as Lambda, Glue, Step Functions, MWAA/Airflow, S3, and API Gateway.
• Integrate internal and external applications using REST APIs, webhooks, and custom connectors.
• Cross-Functional Collaboration
• Work closely with product owners, engineering teams, and business stakeholders to translate requirements into technical integration solutions.
• Participate in architecture discussions and propose integration patterns.
• Data Flow Optimization
• Ensure efficient, reliable, and real-time data movement across systems.
• Optimize ETL/ELT workflows for performance, scalability, and cost efficiency.
• Monitoring & Troubleshooting
• Implement monitoring, logging, and alerts using CloudWatch, X-Ray, and other AWS tools.
• Diagnose and resolve integration failures, performance bottlenecks, and data quality issues.
• Security & Compliance
• Apply best practices for API authentication, authorization, and data protection.
• Utilize AWS security services including IAM, Cognito, KMS, Secrets Manager, Private APIs, etc.
• Documentation
• Prepare and maintain detailed documentation for API specifications, data flows, integration architecture, and operational procedures.
• Innovation & Continuous Improvement
• Stay current with emerging AWS technologies and integration frameworks.
• Recommend improvements to enhance system reliability, performance, and maintainability.

Required Skills and Qualifications:

• Core Experience:-
• 4+ years of hands-on experience in API integration, cloud data engineering, or software development, with a strong focus on building solutions using AWS services.
• Demonstrated experience in designing and implementing data pipelines and system integrations in cloud environments.
• AWS Cloud Expertise: Strong experience with key AWS services including
• API Gateway, Lambda, Step Functions, S3, CloudWatch
• AWS Glue, DynamoDB, SNS/SQS (preferred)
• Experience with serverless architectures and event‑driven workflows.
• API Development & Integration
• Solid understanding of RESTful API design, API lifecycle management, and best practices for integrating multiple applications.
• Experience working with GraphQL (preferred) and various data formats like JSON, XML, Parquet, and CSV.
• Experience with consuming third‑party APIs, secure API communication, and handling throttling, retries, and error-handling logic.
• Programming & Data Engineering Skills
• Proficiency in Python with strong scripting and automation capabilities.
• Experience with PySpark or SQL for data processing (preferred for data engineering roles).
• Strong debugging skills to resolve data, integration, and performance issues.
• Security & Access Management
• Knowledge of IAM, OAuth, token-based authentication, API keys, and role-based access control.
• Understanding of data encryption standards (KMS), VPC security (private APIs), and secure API architecture patterns.
• DevOps & Automation
• Knowledge of Infrastructure as Code (IaC) using Terraform or AWS CloudFormation.
• Familiarity with version control systems such as Git.
• Monitoring & Observability
• Hands-on experience with CloudWatch logs, metrics, alerts, and distributed tracing tools like AWS X-Ray.
• Ability to build dashboards to monitor integration health and API performance.
• Soft Skills
• Excellent written and verbal communication skills, with the ability to collaborate across cross‑functional teams.
• Strong analytical and problem‑solving abilities with an aptitude for troubleshooting complex integration scenarios.
• Ability to work in an Agile/Scrum environment and contribute to sprint planning and solution design.

Preferred Qualifications

• AWS Certification: AWS Certified Solutions Architect, AWS Certified Developer, or simi