Databricks Solutions Engineer

Job Family: Data Engineering & Architecture Consulting

Travel Required: None

Clearance Required: Ability to Obtain Public Trust

What You Will Do:

Guidehouse is excited to invite a Databricks Solutions Engineer to our dynamic AI and Data Defense and Security team. In this pivotal role, you will contribute to client projects focused on building robust data pipelines, troubleshooting critical production workloads, and spearheading Agile delivery teams. Your expertise will directly support organizational goals within the Department of Homeland Security (DHS). Responsibilities include:

• Designing, building, and maintaining scalable ETL pipelines utilizing Databricks, PySpark, SQL, and Delta Lake.
• Demonstrating proficiency in batch and stream processing, autoloader configurations, and compute optimization.
• Troubleshooting and resolving Databricks job failures, cluster performance issues, data quality gaps, and pipeline bottlenecks.
• Implementing CI/CD practices for notebooks, workflows, and data projects.
• Leading Agile Project Management activities including stand-ups, sprint planning, and retrospectives; assisting in backlog refinement.
• Collaborating effectively with cross-functional teams, including data scientists, solution architects, and client stakeholders.
• Communicating technical concepts and delivery impacts to non-technical audiences with clarity.
• Ensuring all engineering deliverables align with data governance, security, and compliance standards (Unity Catalog, Delta constraints, Data Lineage).
• Conducting code reviews, performing data quality validation, and maintaining thorough documentation.

What You Will Need:

• Ability to OBTAIN and MAINTAIN a Federal or DHS Public Trust
• Bachelor's Degree
• 5+ years of relevant experience

What Would Be Nice To Have:

• Active DHS Public Trust
• Law Enforcement experience
• Scrum Master Certification
• Experience managing projects of similar size and scope
• Experience managing IT projects using Agile Scrum or Kanban methodologies
• Experience with commercial cloud infrastructure
• Databricks Data Engineer Associate/Professional Certification
• Familiarity with streaming frameworks (e.g., Kafka, Event Hub)
• Experience with CI/CD tools (Azure DevOps, Jenkins, GitHub Actions)
• Knowledge of Unity Catalog, Terraform, or related Infrastructure as Code (IaC) tools

What We Offer

Guidehouse provides a comprehensive total rewards package that includes competitive compensation and flexible benefits reflecting our commitment to a diverse and supportive workplace. Our benefits include:

• Medical, Rx, Dental & Vision Insurance
• Personal and Family Sick Time & Company Paid Holidays
• Eligibility for a discretionary variable incentive bonus
• Parental Leave and Adoption Assistance
• 401(k) Retirement Plan
• Basic Life & Supplemental Life Insurance
• Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts
• Short-Term & Long-Term Disability coverage
• Student Loan PayDown program
• Tuition Reimbursement, Personal Development & Learning Opportunities
• Skills Development & Certifications
• Employee Referral Program
• Corporate Sponsored Events & Community Outreach
• Emergency Back-Up Childcare Program
• Mobility Stipend

About Guidehouse:

Guidehouse is an Equal Opportunity Employer. We adhere to all laws regarding the employment of protected veterans, individuals with disabilities, and any other legally protected basis. We welcome qualified applicants with criminal histories in compliance with applicable law.

For applicants seeking reasonable accommodations during the recruitment process, please contact Guidehouse Recruiting. All information will be kept confidential and used solely for the purpose of providing necessary accommodations.

Guidehouse does not accept unsolicited resumes through search firms or staffing agencies. All unsolicited resumes will remain the property of Guidehouse.