Azure Data Engineer

Azure Data EngineerFort Worth, TXFinal Round will be OnsiteRate : $115k / Annum

Seeking a 8 + Exp Azure Data Engineer to design, build, and optimize scalable, secure data solutions on Microsoft Azure. The role focuses on building batch/streaming pipelines with SQL, Python, Spark, and Azure-native services, following Agile and DevOps best practices.

Responsibilities

• Design, develop, and maintain data pipelines (batch & streaming) using Azure Data Factory, Databricks, and EventHub.
• Build ETL/ELT workflows for ingestion, transformation, and curation across Blob Storage and Azure Data Lake (ADLS).
• Develop scalable processing jobs with PySpark/Spark SQL for large datasets and performance tuning.
• Implement DevOps practices: version control, CI/CD, environment promotion using Azure DevOps and Maven/Build pipelines.
• Ensure data quality, reliability, and observability (logging, alerting, monitoring) across pipelines.
• Optimize storage formats and partitioning (e.g., Parquet/Delta, Z-ordering) for cost and performance.
• Collaborate with product, analytics, and platform teams in Agile/Scrum to deliver incremental value.
• Enforce security and governance (access controls, secrets, key vaults, data lineage) across Azure services.
• Write efficient SQL for transformations, validations, and performance optimization.
• Document solutions (data flows, runbooks) and support production operations and incident resolution.

Mandatory Skills

• 5-7 years building data solutions using Agile and DevOps practices
• 5-7 years hands-on with SQL, Python, and Apache Spark (PySpark/Spark SQL)
• 5-7 years with Cloud Technologies, with strong preference for Microsoft Azure
• Deep expertise with Azure services:
• Azure EventHub (stream ingestion)
• Azure Data Factory (ADF) (orchestration, ETL/ELT)
• Azure Databricks (Spark, notebooks, Delta)
• Azure DevOps (repos, pipelines/CI-CD)
• Azure Blob Storage
• Azure Data Lake (ADLS Gen2)