Data Scientist Lead/(Databricks/Snowflake AI/ML RAG)

Data Scientist Lead (Databricks/Snowflake AI/ML RAG)

Location: Brampton, ON (Onsite)

Description

We are looking to hire Azure/Snowflake Cortex Consultant at Brampton, ON who will be responsible for driving the architecture, design, development, and delivery of modern cloud, data, and AI solutions.

Role Overview

The Technical Lead will be responsible for driving the architecture, design, development, and delivery of modern cloud, data, and AI solutions. This role blends hands-on technical leadership with strategic oversight, guiding cross-functional engineering teams as they build scalable systems using Microsoft Azure, Databricks AI, and Snowflake Cortex. The Technical Lead will ensure adherence to enterprise security standards, streamline deployment processes, and provide architectural leadership across AI, integration, and cloud modernization initiatives.

Key Responsibilities

Cloud, Data & AI Architecture

• Lead solution design and implementation using Microsoft Azure Foundry, Databricks AI, and Snowflake Cortex.
• Architect and optimize data pipelines, AI workloads, and scalable cloud services.
• Ensure solutions align with enterprise standards, performance requirements, and data governance policies.

Platform Engineering & DevOps

• Oversee environment setup, migration, redevelopment, and automated deployment pipelines.
• Implement CI/CD frameworks, IaC approaches, and repeatable deployment patterns.
• Ensure consistency and reliability across development, testing, and production environments.

Identity, Security & Access Management

• Integrate systems with Active Directory (AD) including:
• Enterprise security model alignment
• Access provisioning and deprovisioning
• Lockout policy implementation
• Least-privilege and zero-trust principles
• Collaborate with cybersecurity teams to ensure compliance and secure-by-design architecture.

AI Engineering & Application Development

• Lead development of AI-centric applications using:
• Prompt Engineering & Context Engineering
• Retrieval-Augmented Generation (RAG)
• AI Orchestration Frameworks
• LLMOps, AI Monitoring, and Evaluation (AI Evals)
• Design and integrate scalable APIs leveraging Azure API Management.
• Drive innovation by exploring new AI capabilities, large language models, and advanced analytics solutions.

Testing, Quality & Data Preparation

• Oversee creation of mock and test data to support unit testing, integration testing, and end-to-end validation.
• Define quality standards for AI model validation, data integrity, and application performance.

Containerization & Modern Deployment

• Lead teams through container-based solution development using Docker, Kubernetes, and cloud-native orchestration tools.
• Ensure optimized workload distribution, reliability, and resilience of deployed services.

Leadership & Collaboration

• Provide technical leadership and mentorship to software engineers, cloud architects, and data teams.
• Collaborate with product owners, business SMEs, and cross-functional teams to translate requirements into actionable solutions.
• Communicate technical concepts clearly to both technical and non-technical stakeholders.

Required Skills & Qualifications

Technical Expertise

• Strong hands-on experience with:
• Azure Foundry
• Databricks AI / ML
• Snowflake Cortex & Snowflake ecosystem
• Azure API Management
• Proficiency in:
• Cloud-native architecture
• Data engineering & MLOps
• RAG pipeline development
• AI evaluation and monitoring
• Containerization (Docker, Kubernetes)

Security & Identity

• Extensive experience with Active Directory integration and enterprise identity management practices.

Software Development

• Strong background in API development, integration patterns, and microservices.
• Knowledge of Python, SQL, and modern cloud-native development frameworks.

Soft Skills

• Excellent problem-solving and analytical skills.
• Strong leadership, mentoring, and communication capabilities.
• Ability to manage multiple initiatives and deliver high-quality solutions.

Preferred Qualifications

• Certifications such as:
• Microsoft Certified: Azure Solutions Architect / Azure AI Engineer
• Databricks Lakehouse Platform or AI Engineer
• Snowflake SnowPro certifications
• Experience in large enterprise cloud modernization programs.
• Background in LLM fine‑tuning, vector databases, and knowledge retrieval systems.