Staff / Principal Machine Learning Engineer, Serving - USA
Inworld AIRole Overview
Inworld AI is hiring a Staff / Principal Machine Learning Engineer, Serving - USA. This is a full-time remote role, with the team based in Remote. Part of Inworld AI's Data Science hiring. The posted range is $270k to $500k. Full responsibilities, required qualifications, and the apply link are listed in the description below.
Resume Keywords to Include
Make sure these keywords appear in your resume to improve ATS scoring
Sign up free to auto-tailor your resume with all these keywords and get a higher ATS score
Job Description
This a Full Remote job, the offer is available from: California (USA)
About Inworld
Inworld is a product-oriented research lab of top AI researchers and engineers, developing best-in-class realtime multimodal models and the only realtime orchestration platform optimized for thousands of queries per second.
We’ve raised more than $125M from Lightspeed, Section 32, Kleiner Perkins, Microsoft’s M12 venture fund, Founders Fund, Meta and Stanford, among others. Our technology has powered experiences from companies such as NVIDIA, Microsoft Xbox, Niantic, Logitech Streamlabs, Wishroll, Little Umbrella and Bible Chat. We’ve also been recognized by CB Insights as one of the 100 most promising AI companies globally and have been named one of LinkedIn's Top 10 Startups in the USA.
Who We're Looking For
A year ago, reliably working agentic systems and sub-second multimodal inference at scale barely existed. Nobody has a decade of experience here. So we're not screening for a resume template — we're looking for strong people from varied backgrounds who learn fast, thrive in ambiguity, and can show us what they've built, broken, and understood.
Experience We Find Useful
You don't need all of this. But you need enough to make a case.
- Inference Optimization. Deep understanding of modern serving frameworks and techniques like vLLM or TRT-LLM.
- Model Acceleration. Hands-on experience with quantization, distillation, caching strategies , continuous batching, paged attention, and speculative decoding.
- High-Performance Systems. Proficiency in C++, CUDA, Rust, or highly optimized Python. You know how to profile code and squeeze every ounce of performance out of NVIDIA GPUs.
- Distributed Systems & Scaling. Experience with Kubernetes, Ray, custom load balancing, multi-GPU/multi-node inference, and reliably handling thousands of concurrent connections.
- Public work. Non-trivial systems programming projects, open-source contributions to major inference engines, or deep-dive technical write-ups.
- Full-cycle ownership. You can take a model from the research team, containerize it, optimize its serving, and ensure it runs reliably in production.
- Background. PhD in CS, Physics, Math, or equivalent practical experience building backend or ML systems.
Who Thrives Here
- You don’t need a roadmap to start walking; you’re comfortable picking a direction and building the map as you go.
- You believe engineering isn't finished until it’s shipped and stable. You have a bias for impact over purely theoretical optimizations.
- You don't just ship code; you obsess over the why. You’re the first to question an architecture if you think there’s a better way to solve the core latency or throughput problem.
- You aren't satisfied with "the PM said so." You thrive on deep context and want to understand the fundamental logic behind every decision we make.
What Working Here Is Like
We hand you unclear problems and expect you to make them clear. We value engineers who say "I don't know yet" and then design the benchmark or prototype that finds out. We treat performance, latency, and reliability as first-class product features, not a box to check before launch. Impact comes before everything else, though we support sharing work and open-source contributions that move the field forward. Your work should be visible. Flat structure, fast iterations, minimal process theater.
We believe in the power of in-person collaboration to solve the hardest problems and foster a strong team culture. We offer relocation assistance and look forward to you joining us in our Mountain View office.
The base salary range for this full-time position is $270,000 - $500,000+ bonus + equity + benefits.
This offer from "Inworld AI" has been enriched by Jobgether.com and got a 72% flex score.
Frequently Asked Questions
How do I apply for the Staff / Principal Machine Learning Engineer, Serving - USA position at Inworld AI?
Use the Apply button above to submit your application directly to Inworld AI. Most applications take less than 5 minutes if your resume and contact details are ready, and you'll be routed to the employer's official application system to finish.
Is the Staff / Principal Machine Learning Engineer, Serving - USA role at Inworld AI remote?
Yes. This is a remote role. The team is based in Remote, but the position itself does not require relocating to that office.
How much does the Staff / Principal Machine Learning Engineer, Serving - USA role at Inworld AI pay?
Inworld AI has posted a compensation range of $270k to $500k for this position. Final offers typically vary based on candidate experience, location, and internal salary bands.
When was the Staff / Principal Machine Learning Engineer, Serving - USA role at Inworld AI posted?
This role was posted on April 8, 2026 (60 days ago). It's still listed as actively hiring; we re-confirm openings against the source system multiple times per day and remove closed roles.
AI-powered job search
Get every job scored to your resume
Upload your resume and get jobs ranked, your resume tailored, and employee contacts found automatically.
Get Started FreeNo credit card to start