Role Overview
Bosonai is hiring a Senior Software Engineer - Systems. This is a full-time role in Santa Clara HQ. posted last week. Full responsibilities, required qualifications, and the apply link are listed in the description below.
Resume Keywords to Include
Make sure these keywords appear in your resume to improve ATS scoring
Job description
About Boson AI: At Boson AI, we are not just building AI solutions; we are pioneering the future of enterprise AI. Driven by a passion for cutting-edge AI research, particularly in the transformative areas of large language models and agentic systems, our mission is to tackle the most complex real-world problems for businesses and unlock significant value. We are a dynamic and collaborative team of researchers and engineers who thrive on pushing the boundaries of what's possible, dedicated to delivering high-quality, reliable products that seamlessly integrate into the fabric of enterprise workflows and set new industry standards.
About the Role: Build and operate the core platform behind Boson's model APIs and agentic products. You'll own the infrastructure that every Boson agent runs on — API serving, state management, data pipelines, context retrieval, and execution runtime — and make it fast, reliable, and easy for product teams to build on.
\n
Responsibilities
Own and evolve the core platform infrastructure: API serving layer, state management, policy enforcement engine, and execution runtime for agentic workflows.
Design and operate high-throughput, low-latency distributed services that back our model API products — including request routing, load management, rate limiting, and multi-tenant isolation.
Build and maintain downstream data pipelines (ETL/ELT) for API logs, usage analytics, and billing — ensuring data correctness, freshness, and queryability at scale.
Develop production-grade internal SDKs and libraries with clean APIs, strong type safety, and clear contracts that product teams can build on confidently.
Architect context and memory systems for conversational workloads — low-latency retrieval, caching, and integration with vector stores and retrieval pipelines.
Instrument end-to-end observability: define SLIs/SLOs, build structured logging and tracing, and drive reliability improvements across the platform.
Collaborate closely with ML and product teams to integrate model serving, voice runtime, and tooling infrastructure under tight latency and quality constraints.
Qualifications
3+ years building and operating backend systems at scale — you've owned services that other teams depend on in production.
Strong distributed systems fundamentals: concurrency, fault tolerance, consistency tradeoffs, capacity planning.
Hands-on experience with data pipeline infrastructure (Kafka/Kinesis, Spark/Flink, Airflow, or similar) for log processing, analytics, or ETL workloads.
Track record of designing APIs and frameworks adopted by other engineering teams — you care about developer experience and long-term maintainability.
Proficiency in at least one systems language (Go, Rust, Java, C++) or Python in a performance-sensitive context.
Comfortable working across the stack: cloud infrastructure (AWS/GCP), containerized deployments (K8s), CI/CD, and production oncall.
Bonus point
Experience with LLM serving, agentic orchestration patterns (ReAct, planner-executor), or RAG pipelines.
Familiarity with emerging agent integration protocols (MCP, A2A) or orchestration frameworks (LangChain, LlamaIndex).
Background in real-time media systems (audio/video streaming, low-latency signaling).
Experience building high-stakes platform services (payments, identity, core data) where correctness and auditability are non-negotiable.
\n$150,000 - $400,000 a year\n
About Bosonai
Bosonai
Frequently Asked Questions
How do I apply for the Senior Software Engineer - Systems position at Bosonai?
Use the Apply button above to submit your application directly to Bosonai. Most applications take less than 5 minutes if your resume and contact details are ready, and you'll be routed to the employer's official application system to finish.
Where is the Senior Software Engineer - Systems position at Bosonai located?
This position is based in Santa Clara HQ. Bosonai has not indicated remote or hybrid options for this role, so candidates should plan for on-site work.
What does a Senior Software Engineer - Systems at Bosonai earn?
Bosonai has not disclosed a salary range in this posting. Many employers share specifics later in the interview process; you can also ask during a recruiter screen if compensation transparency is important to you.
When was the Senior Software Engineer - Systems role at Bosonai posted?
This role was posted on July 8, 2026 (7 days ago). It's still listed as actively hiring; we re-confirm openings against the source system multiple times per day and remove closed roles.
How much experience does the Senior Software Engineer - Systems role at Bosonai require?
This is a senior-level position. Most senior roles call for 5+ years of directly relevant experience. Bosonai lists their specific requirements in the description below, so review the must-have qualifications closely before applying.
AI-powered job search
Get every job scored to your resume
Upload your resume and get jobs ranked, your resume tailored, and employee contacts found automatically.
Get started freeNo credit card to start