Senior Consultant Azure Data Engineer

Overview

Senior Data Engineers at Excella play a key role in designing and building modern data solutions, including data lakes and cleansed data repositories. They develop robust, scalable, and sustainable data pipelines using batch and streaming technologies. Senior Data Engineers collaborate with cross-functional teams, including Architects, Data Scientists, and DevOps, to ensure data availability, quality, and integration.

Responsibilities

• Develop and manage data processes to ensure availability and usability.
• Create and automate data pipelines and platforms.
• Write clean, efficient, and well-documented code to support data engineering solutions.
• Monitor and ensure data quality through automated testing frameworks.
• Collaborate with Architects, Product Owners, Data Scientists, and DevOps to design, build, and maintain scalable data solutions.
• Research data acquisition sources and evaluate suitability.
• Integrate data management solutions into client environments.
• Identify and mitigate risks to data while ensuring data recovery plans.
• Build and maintain data repositories, including data warehouses, data lakes, and operational data stores.

Qualifications

• 3+ years of professional experience in in data engineering and related technical domains.
• Proven ability to build robust, scalable data pipelines and production-grade ETL/ELT systems.
• Strong proficiency in SQL, Python, and orchestration tools like Azure Data Factory.
• Hands-on experience with big data technologies such as Azure DataBricks and file formats like Parquet and Delta Lake.
• Deep experience with cloud data platforms (Azure SQL Database, HDInsight, CosmosDB, Data Lake Storage, Blob Storage, Streaming Analytics, Azure Fabric).
• Solid understanding of data modeling, performance optimization, and designing secure, well-structured data stores.
• Familiarity with data lake and analytical architecture patterns, including Star Schema, schema-on-read, and data quality frameworks.
• Experience with CI/CD, Git, infrastructure-as-code (e.g., Azure DevOps Pipelines), and NoSQL databases.
• Effective communicator with experience working in Agile environments (Scrum/Kanban) and collaborating across technical and non-technical teams.
• Strong problem-solving skills, a growth mindset, and a passion for learning new technologies.
• Technically savvy, entrepreneurial spirit who thrives in environments that reward self-initiative and resourcefulness.

Preferred Qualifications

• Appreciate the importance of schema design and can evolve an analytics schema on top of unstructured data.
• Excited to try out new technologies and produce proofs-of-concept that balance technical advancement and user experience.
• Champion for data privacy and integrity, and always act in the best interest of clients.