Microsoft Azure Data Engineer (4-7 yrs)

Job Title: Data Engineer (Microsoft Azure / Microsoft Fabric)

Experience: 4 – 7 Years

Contract Duration: 2 Months (Extendable)

Start Date: Immediate / ASAP

End Date: 30 April 2026

Shift: Full EST Coverage Preferred

Role Overview

We are seeking a skilled Data Engineer with strong expertise in Microsoft Fabric and the Azure data ecosystem . The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines, transformations, and integrations to support AI-ready analytics and business intelligence workloads .

This is a hands-on role focused on implementing modern Lakehouse architectures and building reliable data pipelines across Bronze → Silver → Gold layers within Microsoft Fabric.

Key Responsibilities

Data Pipeline Development

• Design, build, and maintain data ingestion, transformation, and curation pipelines within Microsoft Fabric.
• Develop and optimize data pipelines across Fabric workspaces for analytics and AI workloads.
• Implement data replication, synchronization, and Change Data Capture (CDC) mechanisms across systems.

Lakehouse & Data Architecture

• Implement and maintain Lakehouse architecture following the Bronze, Silver, and Gold data layers .
• Collaborate with Data Architects, BI teams, and analysts to align lakehouse structures with analytical and AI requirements.
• Optimize data lake performance through partitioning, efficient file formats (Delta, Parquet), and cost-effective storage strategies .

Data Integration & Transformation

• Integrate data from multiple sources and build efficient batch and streaming ingestion pipelines .
• Implement robust ETL/ELT frameworks for scalable data processing.

BI & Semantic Modeling Collaboration

• Work closely with Power BI developers and analysts to deliver optimized semantic models and datasets .
• Ensure datasets are aligned with dimensional models to enable high-performance reporting.

Data Governance & Quality

• Implement data quality checks, transformation standards, and governance controls across data layers.
• Maintain traceability, lineage, and compliance using Microsoft Purview .

Automation & CI/CD

• Build orchestration and monitoring solutions using Azure Data Factory, Synapse, or equivalent tools .
• Develop and maintain CI/CD pipelines using GitHub Actions or Azure DevOps for automated deployments.

Security & Compliance

• Apply enterprise security standards including:
• Encryption at rest and in transit
• Role-Based Access Control (RBAC)
• Data masking and governance policies
• Ensure compliance with NIST, ISO 27000, and SOC 2 standards .

Monitoring & Observability

• Implement data validation, logging, and monitoring frameworks using Azure Monitor or Fabric Data Activator .

Infrastructure Automation

• Support infrastructure deployment using Infrastructure as Code (IaC) tools such as:
• Terraform
• Bicep
• ARM Templates

Continuous Improvement

• Explore and adopt new capabilities within Microsoft Fabric and Azure ecosystem .
• Leverage AI-assisted development tools to enhance delivery speed and efficiency.

Required Skills & Qualifications

• 4–7 years of experience in Data Engineering or Data Platform development.
• Hands-on experience with Microsoft Fabric, Azure Data Factory, Synapse, and Power BI .
• Strong programming skills in SQL and Python .
• Experience building ETL/ELT pipelines and data automation frameworks .
• Experience implementing CDC and large-scale data ingestion pipelines .
• Knowledge of Lakehouse architecture and Bronze–Silver–Gold data modeling .
• Experience building CI/CD pipelines using GitHub Actions or Azure DevOps .
• Experience implementing security controls in Azure data environments .
• Hands-on experience with Microsoft Purview for data governance and lineage .
• Strong collaboration and problem-solving skills.

Tools & Technologies

• Microsoft Fabric
• Azure Data Factory
• Azure Synapse
• Power BI
• Azure SQL
• Azure Data Lake Storage
• Databricks
• Microsoft Purview
• Python
• SQL
• Git
• Terraform / Bicep / ARM Templates
• Azure Monitor

Nice to Have

• Experience with Azure AI Search or vector databases .
• Knowledge of Fabric Data Activator .
• Familiarity with semantic search, embeddings, and Retrieval-Augmented Generation (RAG) .
• Understanding of Data Mesh or Domain-Driven Data Architecture .
• Experience with data observability tools such as Monte Carlo .
• Experience optimizing OneLake performance and cost efficiency .