Scala and Spark Developer

Job Title: Scala and Spark Developer

Job ID:

Job Location: Austin, TX; Morris Plains, NJ

Job Travel Location(s):

# Positions: 1

Employment Type: W2

Candidate Constraints:

Duration:Long Term

# of Layers:0

Work Eligibility:All Work Authorizations are Permitted – No Visa Transfers

Key Technology:

Spark, Scala, Python, Shell scripting, PostgreSQL, and Hadoop

Job Responsibilities: Work with business and technical leadership to understand requirements Participate in sprint planning sessions and help TPOs Troubleshooting the issues, provide effective solutions and application monitoring in productions environment. Skills and Experience Required: 7+ years of strong development experience in Spark, Scala, Python, Shell scripting, PostgreSQL, and Hadoop In depth knowledge on Hadoop architecture and its components Strong working knowledge on Single Store (MEMSQL) database Should have good hands‑on experience working with Indexes, Shard keys, column store, and reference tables using Single Store database. Must understand basic AWS services and hands on experience Basic to moderate Terraform development experience needed Should be able to demonstrate work experience in Hadoop, Spark, hive Strong hands‑on experience on Scala and Spark is must Must have work experience on Hadoop as data warehouse/Data Lake implementations Strong experience on DevOps pipeline implementation Health care domain knowledge is a plus Troubleshooting the Hadoop Yarn jobs is must Strong experience in writing complex and effective SQLs, and Stored Procedures Strong development experience on Single Store database operations Strong profiling skills using Single Store database Strong query optimizations skills to improve performance of ETL process Implement Hadoop job orchestration using Shell scripting, and Airflow Experience in Agile and working knowledge on DevOps tools (Get, Maven, Jenkins, Sonar Cube, and Checkmarks) Unix Shell scripting and basic administration of Unix servers AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and Cloud Watch) Experience in Jira and Confluence Must participate in production support model.

#J-18808-Ljbffr