Senior Software Engineer, Data Centralization & Storage

About the Role

Our engineering department consists of 200+ people across multiple teams, such as application development, infrastructure, data platform, machine learning, and security. We believe our company will win in the long run through product innovation. To get there, we obsess over iteratively delivering customer value through rapid prototyping and data-driven decision-making. 

We’re looking for a self-motivated, highly driven Software Engineer with a strong understanding of low-level distributed systems concepts - not just tool users, but systems thinkers. We want engineers who are comfortable reasoning about how infrastructure behaves under load, how services communicate over the network, and how data flows through complex architectures. Our team is focused on building the platform to support data driven products and strategic outcomes for our customers. We do this by providing an extensible and flexible compute platform to access highly available, mission critical data sets.

What You’ll Accomplish

• Architect high-throughput solutions that power our most critical operations, ensuring scalability and efficiency.
• Expand and enhance our self-service platform, collaborating with cross-functional teams to fuel our AI, ML, and analytics goals.
• Tackle complex distributed data challenges, streamline system integrations, and uphold high standards of quality and governance.
• Champion cutting-edge technologies, keeping our platform at the forefront of industry advancements and enabling strategic outcomes.
• Unify data from diverse systems, paving the way for experimentation and innovation while empowering teams with intuitive tools and frameworks.

Your Expertise

• Track record of debugging issues across layers—from application logic to infrastructure bottlenecks—and understand the tradeoffs in system design, not just the settings in a managed UI.
• You don’t just know how to run jobs in tools, you understand how they operate under the hood and how connected storage impacts performance like,
  • How simple storage API semantics (e.g. consistency, eventual visibility, multi-part uploads) affect job execution
  • The impact of network I/O and data locality on performance and cost
  • The way resource scheduling and JVM tuning influence distributed job behavior
• Proven experience as a Software Engineer with a focus on high throughput scalable systems.
• In-depth knowledge of high throughput processing technologies such as Spark, Flink, and/or Kafka. 
• Proficiency in Java and strong understanding of object-oriented design, data structures, algorithms, and optimization.
• You have development experience working with data warehouse tools like Snowflake, Clickhouse, Trino, etc 
• You’ve experience with open source data storage formats such as Apache Iceberg, Parquet, Arrow, or Hudi
• You are knowledgeable about data modeling, data access, and data replication techniques, such as CDC. 
• You have a proven track record of architecting applications at scale and maintaining infrastructure as code via Terraform
• You are excited by new technologies but are conscious of choosing them for the right reasons

What We Use

• Our backend is Java / Kotlin / Spring Boot microservices, built with Gradle, coupled with things like DynamoDB, Aurora, AirFlow, Postgres, and Redis, hosted via AWS
• Our infrastructure runs primarily in Kubernetes hosted in AWS’s EKS, using tooling like Istio, Datadog, Terraform, CloudFlare, and Helm
• Our frontend is built with React and TypeScript, and uses best practices like GraphQL, Storybook, Radix UI, Vite, esbuild, and Playwright
• Our automation is driven by custom and open source machine learning models, industry-leading LLMs, lots of data and tech like Python, Metaflow, HuggingFace, PyTorch, TensorFlow, and Pandas

You'll get competitive perks and benefits, from health & wellness to equity, to help you bring your best self to work.

For US based applicants:

• The US base salary range for this full-time position is $150,000 - $205,000 annually + equity + benefits
• Our salary ranges are determined by role, level and location

#LI-CM1

By applying for this position, your data will be processed as per Attentive's Privacy Policy.