Lead Data Engineer; Java, Python, Spark, AWS

Position Overview

The Lead Data Engineer at Capital One is responsible for designing, developing, testing, implementing, and supporting data solutions using Java, Python, Spark, and AWS in an Agile environment. In this role, you will collaborate with cross-functional teams, mentor engineers, and drive business transformation by leveraging cloud-based data warehousing and big data tools. If you love pioneering innovative technology solutions and solving complex business problems in a collaborative and fast-paced setting, this role is for you.

Key Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions using full-stack development tools.
• Work with developers experienced in machine learning, distributed microservices, and full stack systems.
• Utilize programming languages like Java, Scala, and Python along with both SQL and NoSQL databases, and leverage cloud-based data warehousing services such as Redshift and Snowflake.
• Share your passion for technology by staying updated on tech trends, experimenting with new technologies, and mentoring fellow engineers.
• Collaborate with digital product managers to deliver robust cloud-based solutions that empower millions of Americans.
• Perform unit tests and conduct code reviews to ensure quality, performance, and maintainability of solutions.

Required Qualifications

• Bachelor’s Degree
• Minimum 4 years of experience in application development (internship experience does not apply)
• At least 2 years of experience in big data technologies
• At least 1 year of experience with cloud computing (AWS, Microsoft Azure, or Google Cloud)

Preferred Qualifications

• 7+ years of application development experience including Python, SQL, Scala, or Java
• 4+ years of experience with a public cloud (AWS, Microsoft Azure, or Google Cloud)
• 4+ years of experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
• 4+ years of experience with real-time data and streaming applications
• 4+ years of experience with NoSQL implementations (e.g., Mongo or Cassandra)
• 4+ years of data warehousing experience (Redshift or Snowflake)
• 4+ years of Unix/Linux experience including basic commands and shell scripting
• 2+ years of experience with Agile engineering practices

Benefits & Perks

• Compensation: McLean, VA: $193,400 - $220,700 for Lead Data Engineer
• Compensation: Plano, TX: $175,800 - $200,700 for Lead Data Engineer
• Compensation: Richmond, VA: $175,800 - $200,700 for Lead Data Engineer
• Note: Salaries for part-time roles will be prorated based on the agreed-upon number of hours.