Overview

We are seeking a Senior Data Platform Engineer to design, build, and optimize scalable data platforms that support enterprise analytics, AI/ML, and mission-critical applications. This role will operate at the intersection of data engineering, platform engineering, and DevSecOps, enabling high-performance data pipelines, real-time processing, and robust data infrastructure.

The ideal candidate has deep experience building cloud-native data platforms, implementing ETL/ELT pipelines, and supporting large-scale distributed systems across secure and high-availability environments.

Required Qualifications

• Active TS/SCI Clearance with the ability to obtain a Polygraph. Candidates without a TS/SCI clearance will not be considered
• 7+ years of experience in data engineering, platform engineering, or software engineering
• Strong experience building end-to-end data platforms and pipelines
• Proficiency in programming languages such as:
• Python
• SQL
• Java or Scala
• Hands-on experience with modern data tools such as:
• Databricks, Snowflake, or BigQuery
• Apache Spark, Airflow, or similar orchestration tools
• Kafka or other streaming technologies
• Experience with cloud platforms (AWS, Azure, or GCP)
• Strong understanding of:
• Data modeling (OLTP/OLAP, dimensional modeling)
• Data governance and data quality practices
• Distributed systems and scalability

Key Responsibilities

• Design, develop, and maintain scalable data platforms supporting batch and real-time workloads
• Build and optimize data ingestion, processing, and transformation pipelines (ETL/ELT)
• Implement data workflows for structured, semi-structured, and unstructured data across enterprise systems
• Develop and maintain data models, schemas, and metadata frameworks aligned with enterprise standards
• Deploy and manage distributed data infrastructure (data lakes, warehouses, streaming platforms)
• Integrate pipelines with APIs, analytics tools, and downstream applications
• Build and support real-time streaming architectures (Kafka, Pub/Sub, Kinesis, etc.)
• Implement data validation, quality controls, and governance processes
• Support DevSecOps and CI/CD integration for data platform deployments
• Troubleshoot, tune, and optimize data platform performance and reliability
• Collaborate with data scientists, software engineers, and architects to deliver end-to-end data solutions
• Lead technical design discussions and mentor junior engineers

Insight Global is hiring multiple candidates for this role and exact pay will vary based on candidates level of experience, expertise, degrees, and clearance level. We anticipate paying 170K - 210K for these openings along with health, vision, dental, and 401k benefits