Lead Data Engineer

Job Description

What is the opportunity?

Lead Data Engineer on the Insurance Data Lake team in Technology & Operations at the Royal Bank of Canada. The Lead Data Engineer role is an exciting opportunity for a talented and motivated individual to lead a high-performing team, drive innovation, and make a meaningful impact within RBC’s Insurance Data Lake team. If you are passionate about data engineering, thrive in a collaborative environment, and are ready to take on new challenges, this role is the perfect fit for you.

What will you do?

• The role of a Lead Data Engineer is multifaceted, requiring a blend of technical expertise, leadership skills, and strategic thinking.
• Responsible for driving the success of data engineering initiatives, mentoring their team, and ensuring that data systems meet the organization’s needs.
• Fostering collaboration, innovation, and continuous improvement, a Lead Data Engineer plays a critical role in enabling data-driven decision-making and delivering value to the organization.
• Lead, mentor, and guide a team of data engineers, fostering a culture of collaboration, innovation, and continuous learning.
• Provide technical guidance and support to team members, helping them solve complex problems and grow their skills.
• Performing analysis on structured, unstructured, and semi-structured raw data, utilizing programming skills to standardize and organize data.
• Design and implement scalable, reliable, and efficient data pipelines and workflows.
• Stay updated on emerging technologies and tools in data engineering, such as cloud platforms (AWS, Azure, GCP), big data frameworks (Hadoop, Spark), and modern data platforms (Snowflake, Databricks).
• Evaluate and recommend tools, frameworks, and technologies to improve data engineering processes.
• Ensure data systems are optimized for performance, scalability, and security.
• Identifying, sourcing, staging, and modeling internal process improvements to automate manual processes and optimize data delivery for greater scalability, as part of the end-to-end data lifecycle.
• Oversee the integration of data from multiple sources, ensuring data consistency, quality, and accessibility.
• Develop ETL/ELT processes to transform raw data into usable formats for analytics and reporting
• Provides consulting services on new initiatives of small to medium complexity.
• Supports Development for data ingestion and transformation jobs. Develops and supports Python and SQL code for data ingestion and transformation jobs.
• Create IBM JCL and job scheduling documents as needed. Contributes to successful project completion by identifying risks and developing/recommending mitigation strategies.

What do you need to succeed?

Must-haves:

• 7+ years working experience with bigdata platforms like Cloudera/Snowflake/Hadoop, Databases and SQL language.
• 5+ years working experience with Scripting languages like Spark, PySpark, Shell, Python, IT Standards, Methodologies, Agile, SDLC, Information Security & audit requirements.
• Prior experience leading complex projects and technical team.
• Working Knowledge with change control tools like GitHub, Helios etc.
• Knowledge on creating formal written deliverables and other documentation and ensure design, code and documents are aligned with enterprise direction, principles and standards.

Nice-to-have:

• Working knowledge of JCL/Zeke/OMS.
• Working knowledge of ServiceNow Incident and Change Management.
• Working knowledge of Helios/GitHub for Source Code Management.
• Insurance industry knowledge

What’s in it for you

We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.

• A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
• Leaders who support your development through coaching and managing opportunities
• Ability to make a difference and lasting impact
• Work in a dynamic, collaborative, progressive, and high-performing team
• A world-class training program in financial services
• Opportunities to do challenging work
• Opportunities to take on progressively greater accountabilities
• Opportunities to building close relationships with clients
• Access to a variety of job opportunities across business and geographies

#LI-Post

#LI-PK

Job Skills

Big Data Management, Cloud Computing, Database Development, Data Mining, Data Warehousing (DW), ETL Processing, Group Problem Solving, Quality Management, Requirements Analysis

Additional Job Details

Address:

MEADOWVALE BUSINESS PARK, 6880 FINANCIAL DR:MISSISSAUGACity:

MississaugaCountry:

CanadaWork hours/week:

37.5Employment Type:

Full timePlatform:

TECHNOLOGY AND OPERATIONSJob Type:

Re