Skip to main content
Realm logo

Senior Product Manager- Walmart +

Realm
Full Timemanager
Sunnyvale, California, USPosted April 3, 2026

Job Description

Senior Product Manager: AI Platform & Managed Services ($600mill in funding) $250K + Equity We are building a next-generation AI platform that enables developers and enterprises to train, deploy, and operate large-scale machine learning systems across heterogeneous compute environments. Our focus is on making cutting-edge AI infrastructure usable, scalable, and efficient - abstracting away the complexity of distributed systems, multi-GPU orchestration, and model lifecycle management into a cohesive, developer-first platform. This is a high-impact role at the intersection of AI infrastructure, distributed systems, and developer platforms , where you will define and build the product layer that sits between raw compute and real-world AI applications. You will lead product across key areas of our AI platform and managed services stack, including: Inference & Model Serving Platforms Design systems for high-throughput, low-latency inference across LLMs, diffusion models, and multimodal workloads Balance performance, cost, and reliability across diverse workloads AI Platform & Developer Experience Define primitives for fine-tuning, evaluation, deployment, and observability Simplify complex infrastructure into intuitive, composable building blocks Work on scheduling and workload placement across heterogeneous environments (GPU/CPU, multi-region, multi-cloud) Define telemetry systems for model performance, latency, token usage, and failure modes Build evaluation workflows for LLM quality, safety, and regression detection Introduce cost controls and optimization strategies for large-scale inference and training Package infrastructure into opinionated, production-ready services for enterprise customers Work closely with customers to understand real-world constraints and translate them into product capabilities We’re looking for product leaders who can operate at depth across both systems and product , and who are excited about building the foundation for the next generation of AI applications.

Experience building AI/ML platforms, inference systems, or developer-facing infrastructure Strong understanding of distributed systems, cloud infrastructure, and performance trade-offs LLMs, transformers, diffusion models AI is undergoing a platform shift.

This role is about closing that gap: turning fragmented, complex infrastructure into a coherent platform that developers can rely on to build real products. If you’re excited about building the systems that power the next generation of AI applications, apply now!

Want AI-powered job matching?

Upload your resume and get every job scored, your resume tailored, and hiring manager emails found - automatically.

Get Started Free