Lead Data Engineer

Lead Data Engineer

We are seeking an experienced Lead Data Engineer to play a crucial role in the design, development, and optimization of our data pipelines. You will ensure the creation of reliable, scalable, and high-performing data infrastructure that empowers our organization to make data-driven decisions. By managing complex data workflows, integrating various data sources, and maintaining data quality, your efforts will directly contribute to enhancing the company’s ability to derive actionable insights and improve operational efficiency.

Key Responsibilities:

• Lead efforts in extracting engineering data from diverse sources, including structured and unstructured formats like PDF documents.
• Develop detailed mapping strategies between different datasets and implement effective normalization and standardization techniques.
• Create Source to Target mapping documents with corresponding business rules through collaboration with various stakeholders.
• Work closely with cross-functional teams to set and uphold data standards and ensure data quality.
• Design, implement, and manage scalable databases capable of accommodating large volumes of data.
• Develop and maintain efficient ETL processes to facilitate seamless data flow and transformation, while ensuring data integrity through robust error handling and validation.
• Engage with domain experts, data stewards, and project teams for effective data integration.
• Utilize a variety of technologies, including scripting languages and data integration tools.
• Maintain thorough documentation of all data engineering processes.