Senior Staff Data Engineer: Platform Data and Analytics

About this role

Our Engineering organization owns the software that makes our marketplace work. The Platform group empowers teams across Faire: Product Engineering, Data Science, Product Management, Strategy, Analytics, Finance, etc. Enabling these functions to do their best work without concern about underlying infrastructure. We enable product engineering teams to build and operate software with unmatched speed and quality. We care about good engineering practices, excellent developer experience, security, testability, ease of maintenance, and scaling to serve millions of users. We value best practices to achieve excellent availability and performance.

This role is for a highly experienced technical leader in the data space, whose influence spans multiple Platform and Product groups.

Within the Platform group:

• The Data Infrastructure team builds and operates a secure, reliable, cost-efficient, opinionated platform for data ingestion, storage, compute, orchestration, and governance.
• The Analytics Platform team builds efficient data warehousing capabilities, foundational data assets, and tools to accelerate data-driven analytics. Its mandate is to reduce time from data to insights.

The teams also own relationships with relevant technology infrastructure vendors.

Additionally, this role would influence and interact with all data and analytics related functions at Faire. The product analytics engineering (PAE) function enables domain-specific AE capabilities, working closely with Data Science, Strategy & Analytics, Finance. The data science (DS) function leads modeling development and evaluation, raising effectiveness and efficiency of key product features.

We're looking for: An experienced technical leader with data and analytics background to work alongside and lead / influence across multiple teams and departments. Define technology strategy, roadmaps, architecture patterns and guidance. Striking the right balance of technical leadership and hands-on development.

What you'll do

• Plan and execute on technology projects that scale with Faire's growth; lead architecture development with a focus on data integrity, security, performance, scale, reliability, monitoring/alerting.
• Engage with team planning and prioritization, balancing urgent and near-term needs with long-term goals.
• Provide technical guidance and mentorship on the most difficult open-ended problems we face. Including cost-efficient compute and storage, ETL and ELT pipelines, data ingest and warehousing, monitoring, alerting, and cost tracking for workloads, design practices for foundational assets, data security, privacy, and governance.

Qualifications

• Experience designing, developing, and operating data streaming, batch, ETL/ELT, orchestration, storage, compute, workflow systems at scale.
• Experience defining architecture patterns and building reliable, scalable data pipelines, orchestration of data movement, querying, transformation, and frameworks for analytics engineering workflows.
• Strong SQL and Python skills and experience.
• Data warehousing experience at Petabyte scale.
• Snowflake, Airflow, Spark experience especially valuable.
• Understanding of performance, capacity, cost trade-offs in data processing systems. Experience in guiding technical and product teams on such trade-offs.
• Experience diagnosing, mitigating, and permanently addressing data system production issues at scale. Experience rolling out patterns for workload performance and cost optimization.
• Experience operating in a growth stage company, with a data function consisting of multiple teams and over 60 people. Enabling teams to operate in a self-serve model.
• Excellent communication, leadership, and influencing skills.
• A bachelor's degree in Computer Science/Software Engineering or equivalent industry experience.
• Select technologies we use and teach: AWS, Snowflake, Airflow, Spark, Python, Kotlin.

Salary Range

San Francisco: the pay range for this role is $268,000 to $368,500 per year.

Canada: the pay range for this role is $228,000 to $313,500 per year.

This role will also be eligible for equity and benefits. Actual base pay will be determined based on permissible factors such as transferable skills, work experience, market demands, and primary work location. The base pay range provided is subject to change and may be modified in the future.

Faire uses Artificial Intelligence (AI) to screen and select applicants for this position.

This job posting is for an existing vacancy.