Sr. Data Engineer (Apache Spark)

Our client, a leading organization in the data and technology sector, is seeking a Sr. Data Engineer (Apache Spark) to join their team. As a Sr. Data Engineer (Apache Spark), you will be part of the Data Engineering Department supporting the Data Solutions team. The ideal candidate will demonstrate strong problem-solving skills, excellent collaboration abilities, and a proactive mindset, which will align successfully in the organization.

Job Title: Sr. Data Engineer (Apache Spark)

Location: Charlotte, NC

What's the Job?

• Consult on or participate in moderately complex initiatives within Software Engineering, contributing to large-scale planning and deliverables.
• Review and analyze complex Software Engineering challenges, providing in-depth evaluations and solutions.
• Collaborate with client personnel to meet Software Engineering deliverables, leveraging understanding of policies, procedures, and compliance requirements.
• Build and enhance new functional features in the SparkFlow framework, including sources, targets, transformations, and governance controls.
• Support integrating SparkFlow into the Unity control plane by developing interfaces, adapters, and automation workflows.

What's Needed?

• 4+ years of Software Engineering experience, with a focus on Apache Spark (Scala, Java, or Python).
• Experience building frameworks and libraries, including API and abstraction design.
• Proficiency with CI/CD tools, Git, and build systems like Maven or Gradle.
• Knowledge of enterprise data ecosystem components such as Hadoop, Hive, Kafka, and cloud storage solutions.
• Strong understanding of database concepts, UNIX bash scripting, and Spark performance tuning.

What's in it for me?

• Opportunity to work on innovative data processing frameworks and AI-enabled solutions.
• Engagement with cutting-edge technologies in a collaborative environment.
• Chance to contribute to large-scale enterprise data initiatives.
• Supportive team environment fostering professional growth.
• Competitive pay rate aligned with your expertise and experience.

If this is a role that interests you and you'd like to learn more, click apply now and a recruiter will be in touch with you to discuss this great opportunity. We look forward to speaking with you!

About ManpowerGroup, Parent Company of: Manpower, Experis, Talent Solutions, and Jefferson Wells.

ManpowerGroup® (NYSE: MAN), the leading global workforce solutions company, helps organizations transform in a fast-changing world of work by sourcing, assessing, developing, and managing the talent that enables them to win. We develop innovative solutions for hundreds of thousands of organizations every year, providing them with skilled talent while finding meaningful, sustainable employment for millions of people across a wide range of industries and skills. Our expert family of brands – Manpower, Experis, Talent Solutions, and Jefferson Wells – creates substantial value for candidates and clients across more than 75 countries and territories and has done so for over 70 years. We are recognized consistently for our diversity - as a best place to work for Women, Inclusion, Equality and Disability and in 2023 ManpowerGroup was named one of the World's Most Ethical Companies for the 14th year - all confirming our position as the brand of choice for in-demand talent.