Azure Data Engineer | 4 to 10 years | Navi Mumbai | 18 to 30 LPA | Big4

Job Title: Azure Data Engineer

Experience: 5 to 10 Years

Budget: 20 to 30 LPA

Location: Navi Mumbai

Type: Full-Time

Skills Required: Azure, Synapse, ADF, spark, SQL, Pyspark, spark-SQL

Job Description

Key Responsibilities:

• Designs, implements and maintains reliable and scalable data infrastructure
• Writes, deploys and maintains software to build, integrate, manage, maintain,

and quality-assure data

• Develops, and delivers large-scale data ingestion, data processing, and data

transformation projects on the Azure cloud

• Mentors and shares knowledge with the team to provide design reviews,

discussions and prototypes

• Works with customers to deploy, manage, and audit standard processes for

cloud products

• Adheres to and advocates for software & data engineering standard processes

(e.g. Data Engineering pipelines, unit testing, monitoring, alerting, source

control, code review & documentation)

• Deploys secure and well-tested software that meets privacy and compliance

requirements; develops, maintains and improves CI / CD pipeline

• Service reliability and following site-reliability engineering standard processes:

on-call rotations for services they maintain, responsible for defining and

maintaining SLAs. Designs, builds, deploys and maintains infrastructure as code.

Containerizes server deployments.

• Part of a cross-disciplinary team working closely with other data engineers,

Architects, software engineers, data scientists, data managers and business

partners in a Scrum/Agile setup

Job Requirements:

Education

Bachelor or higher degree in computer science, Engineering, Information

Systems or other quantitative fields

Experience

1) Years of experience: 6 to 9 years relevant experience

2) Deep and hands-on experience building, productionizing, maintaining and

documenting reliable and scalable data infrastructure and data products in

complex environments

3) Hands on experience with:

a) Spark for data processing (batch and/or real-time) - must

b) Configuring Delta Lake on Azure Databricks – good to have

c) Languages: SQL, pyspark, python - must

d) Cloud platforms: Azure - must

e) Azure Data Factory (must) , Azure Data Lake (must), Azure SQL DB (must),

Synapse (must), SQL Pools (must), Databricks (good to have)

f) Building data solutions in Azure incl. data distributions and partitions,

scalability, cost-management, disaster recovery and high availability

g) Azure Devops (or similar tools) for source control & building CI/CD pipelines –

good to have

4) Experience in implementing large-scale distributed systems

5) Customer management and front-ending and ability to lead large

organizations through influence

Desirable Criteria :

• Strong customer management- own the delivery for Data track with customer

stakeholders

• Continuous learning and improvement attitude

Key Behaviors :

• Empathetic: Cares about our people, our community and our planet
• Curious: Seeks to explore and excel
• Creative: Imagines the extraordinary
• Inclusive: Brings out the best in each other