Senior Data engineer for the Data engineering

Project Summary

We are seeking an experienced Data Architect or Database Performance Engineer for a short-term engagement to audit and optimize our database bulk ingestion process.

Our system handles large-scale data imports, and we are experiencing performance bottlenecks.

We need an expert to quickly assess the current setup, identify inefficiencies, and recommend actionable improvements to increase ingestion speed while maintaining data integrity.

Scope of Work

Review current database configuration and ingestion workflow

Identify performance bottlenecks (I/O, indexing, locking, batching, etc.)

Provide specific optimization recommendations

Suggest improvements for maintaining data integrity during bulk loads

Deliver a short written summary of findings and next steps

Deliverables

Performance assessment summary

Clear, prioritized optimization recommendations

Estimated impact of proposed improvements

This is a focused diagnostic and optimization task, not a full system rebuild. Ideal for someone who can quickly analyze complex database environments and provide high-impact guidance.

Contract duration of less than 1 month. with 30 hours per week.

Mandatory skills:

ETL Pipeline, Python, Big Data, Apache Spark, Microsoft Excel, SQL, Tableau, Data Management, Data Modeling, Data Science