Spark/scala

Description

Build and Maintain distributed, scalable, and reliable data pipelines that ingest and process data at scale and in real-time Create metrics and apply business logic using Spark, Scala Model, design, develop, code, test, debug, document and deploy application tproduction through standard processes Harmonize, transform, and move data from a raw format tconsumable, curated views Analyze, design, develop, and test applications Contribute tthe maturation of Data Engineering practices, which may include providing training and mentoring tothers Troubleshooting application issues by writing code, compiling, debugging, analyzing and reviewing complex application code