Principal Data Platform Engineer

Overview

The Data & Insights organization at Insight Global is responsible for delivering Trusted Data & Verified Insights to drive business decisions across the company. As a Data Engineer based in Hyderabad, India , you will be part of a newly established offshore team focused on building and maintaining scalable data pipelines, supporting platform operations, and enabling analytics, data science, and machine learning use cases.

This is a hands-on role reporting to the Data Engineering Manager with direct impact on Insight Global’s ability to deliver high-quality, actionable data to the business.

Primary Responsibilities

Design and build scalable, reliable data pipelines for analytics and data science. Monitor and maintain data pipelines, automate operational tasks, and ensure SLA adherence. Troubleshoot and fix bugs across the data platform, contributing to platform stability and performance. Improve data quality, performance, and process efficiency. Develop and maintain metadata catalogs and optimize resource usage. Apply CI/CD and automated testing to ensure code quality and deployment reliability. Collaborate across business, analytics, and IT teams to deliver data solutions. Work with structured and unstructured data in both batch and streaming environments. Participate in on-call rotations and support deployment activities.

Required Skills

5+ years of experience in Data Engineering, Analytics, or Software Engineering. Strong SQL skills for data analysis and pipeline development. Proficiency in Python (PySpark) for data pipeline creation and troubleshooting. Experience with Databricks and Azure Data Factory. Effective communication and collaboration across technical and business teams. Experience structuring data for analytics and machine learning.

Preferred Skills

Experience with Databricks Unity Catalog. Familiarity with data modeling and diagramming tools. Focus on continuous improvement and data quality. Exposure to operational monitoring and incident response practices.

This Role Is Ideal If You:

Are excited to be part of a growing offshore team and help shape its success. Thrive in Agile environments and enjoy working across disciplines. Take ownership of both development and operational responsibilities. Are passionate about delivering reliable, high-quality data solutions. Embody Insight Global’s shared values and contribute to a collaborative, high-performance culture.