Senior Machine Learning OPS

<div class="content-intro"><p>Inovalon was founded in 1998 on the belief that technology, and data specifically, would empower the transformation of the entire healthcare ecosystem for the better, improving both outcomes and economics. At Inovalon, we believe that when our customers are successful in their missions, healthcare improves. Therefore, we focus on empowering them with data-driven solutions. And the momentum is building.</p> <p>Together, as ONE Inovalon, we are a united force delivering solutions that address healthcare’s greatest needs. Through our mission-based culture of inclusion and innovation, our organization brings value not just to our customers, but to the millions of patients and members they serve.</p></div><p><strong>About Us:</strong></p> <p>Inovalon is a leading healthcare technology company dedicated to revolutionizing the healthcare industry through innovative AI and machine learning solutions. Our mission is to leverage cutting-edge technology to improve health outcomes and streamline healthcare processes. We are seeking a highly skilled Senior Machine Learning SDET to ensure the quality, reliability, and safety of our ML-powered healthcare products.</p> <p><strong>Job Description:</strong></p> <p>As a Senior Machine Learning SDET, you will be responsible for designing, implementing, and maintaining robust testing frameworks and quality strategies for machine learning systems across their entire lifecycle. You will collaborate closely with data scientists, ML engineers, software engineers, and product managers to validate models, data pipelines, and ML-driven services in production environments. Your work will help ensure that our ML solutions are accurate, performant, secure, and compliant with healthcare standards, ultimately improving patient care and operational efficiency.</p> <p><strong>Key Responsibilities:</strong></p> <ul> <li>Test Strategy for ML Systems: Define and own the end-to-end test strategy for ML models, data pipelines, and services, including functional, performance, regression, and reliability testing.</li> <li>ML Model Validation: Design automated tests to validate model behavior (e.g., accuracy, drift detection, bias, stability, and robustness) across training, staging, and production environments.</li> <li>Data Quality &amp; Pipeline Testing: Build automated tests and monitoring for data pipelines to ensure schema integrity, data completeness, data freshness, and correctness for training and inference.</li> <li>Test Automation Frameworks: Develop and maintain scalable test automation frameworks and tools for APIs, microservices, and ML workflows, integrating them into CI/CD pipelines.</li> <li>Performance &amp; Scalability: Design and execute load and performance tests for ML inference services and batch jobs, focusing on latency, throughput, and resource utilization.</li> <li>Monitoring &amp; Observability: Collaborate with ML and platform engineers to implement monitoring, logging, and alerting for ML systems, including model performance and data drift.</li> <li>Shift-Left Quality: Embed quality practices early in the ML development lifecycle, including testable model design, test data generation, and automated validation in CI.</li> <li>Tooling &amp; Infrastructure: Leverage and extend existing tools (e.g., Python test frameworks, cloud services, containerization, big data tools) to support robust ML testing.</li> <li>Collaboration: Work closely with cross-functional teams to understand business and regulatory requirements and translate them into verifiable test scenarios and acceptance criteria.</li> <li>Mentorship: Provide guidance and mentorship to engineers on best practices for testing ML and data-intensive systems, fostering a culture of quality and continuous improvement.</li> </ul> <p><strong>Qualifications:</strong></p> <ul> <li>Education: Bachelor’s or Master’s degree in Computer Science, Engineering, Mathematics, or a related field; Ph.D. is a plus.</li> <li>Experience: Minimum of 5 years of experience in software test engineering or SDET roles, with at least 3 years focused on testing machine learning, data, or distributed backend systems in production.</li> </ul> <p><strong>Technical Skills:</strong></p> <ul> <li>Strong proficiency in Python and testing frameworks such as pytest, unittest, or similar, with experience testing ML code and data pipelines.</li> <li>Hands-on experience with ML libraries and ecosystems (e.g., TensorFlow, PyTorch, scikit-learn) sufficient to design model validation and testing strategies.</li> <li>Hands-on experience with generative AI concepts (LLMs, RAG, vector databases, prompt engineering, and transfer learning) and their testing implications is a strong plus.</li> <li>Experience with cloud platforms (AWS, GCP, or Azure) and containerization/orchestration (Docker, Kubernetes) for deploying and testing ML services.</li> <li>Strong knowledge of data structures, algorithms, and software engineering best practices, including code reviews, version control, and CI/CD.</li> <li>Experience building and integrating automated tests for REST/gRPC APIs and microservices, including contract and integration testing.</li> <li>Experience with performance and load testing tools and techniques for backend and ML inference services.</li> <li>Experience with observability and monitoring tools (e.g., Prometheus, Grafana, ELK, or cloud-native equivalents) for tracking model and system health.</li> </ul> <p><strong>Domain Knowledge:</strong></p> <ul> <li>Understanding of healthcare data standards (e.g., HL7, FHIR) and regulations (e.g., HIPAA) is a plus.</li> <li>Experience testing systems in regulated, high-compliance, or safety-critical environments is highly desirable.</li> </ul> <p><strong>Soft Skills:</strong></p> <ul> <li>Excellent problem-solving and analytical skills, with a strong focus on edge cases, failure modes, and risk assessment.</li> <li>Strong communication and collaboration abilities, with comfort working across ML, data, product, and platform teams.</li> <li>Ability to work independently and as part of a team in a fast-paced environment, balancing quality, speed, and pragmatism.</li> </ul> <p><strong>What We Offer:</strong></p> <ul> <li>Competitive salary and benefits package.</li> <li>Opportunity to work on impactful ML-driven healthcare products that improve patient outcomes and operational efficiency.</li> <li>Collaborative and innovative work environment.</li> <li>Professional development and growth opportunities in ML quality engineering and SDET leadership.</li> <li>Flexible work arrangements, including hybrid and remote options.</li> </ul> <p>Join us in ensuring that cutting-edge AI and machine learning solutions are not only powerful but also safe, reliable, and trustworthy in healthcare. We look forward to hearing from you.</p> <p>&nbsp;</p><div class="content-conclusion"><p><em><span data-contrast="auto">This position is not eligible for immigration sponsorship (e.g. H-1B, TN, or E-3). Applicants must be authorized to work in the United States as a condition of employment. (This is only applicable for US-based positions)</span></em></p> <p><em><span data-contrast="auto">If you don’t meet every qualification listed but are excited about our mission and the work described, we encourage you to apply</span><span data-contrast="auto">.&nbsp; Inovalon is most interested in finding the best candidate for the job</span><span data-contrast="auto">,</span><span data-contrast="auto"> and you may be just the right person for this or other roles.</span><span data-ccp-props="{}">&nbsp;</span></em></p> <p><em><span data-contrast="auto">By embracing </span><span data-contrast="auto">inclusion</span><span data-contrast="auto">, </span><span data-contrast="auto">we enhance our work environment and drive business success. Inovalon strives to </span><span data-contrast="auto">provide equal opportunit</span><span data-contrast="auto">ies</span><span data-contrast="auto"> to</span><span data-contrast="auto"> the communities where we operate and to our clients and everyone whom we serve. We endeavor to create a culture of inclusion in which our associates feel empowered to bring their full, authentic selves to work and pursue their professional goals in an equitable setting. We understand that by fostering this type of culture, and welcoming different perspectives, we generate innovation and growth.</span><span data-ccp-props="{}">&nbsp;</span></em></p> <p><em><span data-contrast="auto">Inovalon is proud to be an equal opportunity workplace</span><span data-contrast="auto">. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or </span><span data-contrast="auto">v</span><span data-contrast="auto">eteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirement.</span><span data-ccp-props="{}">&nbsp;</span></em></p> <p><em><span class="ui-provider bsa bsb bsc bsd bse bsf bsg bsh bsi bsj bsk bsl bsm bsn bso bsp bsq bsr bss bst bsu bsv bsw bsx bsy bsz bta btb btc btd bte btf btg bth bti">To review the legal requirements, including all labor law posters, please visit this <a class="fui-Link ___10kug0w f3rmtva f1ewtqcl fyind8e f1k6fduh f1w7gpdv fk6fouc fjoy568 figsok6 f1hu3pq6 f11qmguv f19f4twv f1tyq0we f1g0x7ka fhxju0i f1qch9an f1cnd47f fqv5qza f1vmzxwi f1o700av f13mvf36 f1cmlufx f9n3di6 f1ids18y f1tx3yz7 f1deo86v f1eh06m1 f1iescvh fhgqx19 f1olyrje f1p93eir f1nev41a f1h8hb77 f1lqvz6u f10aw75t fsle3fq f17ae5zn" href="https://postings.govdocs.com/#/8sZXnFNWk3KYs3F" target="_blank">link</a></span></em></p> <p><em><span class="ui-provider bsa bsb bsc bsd bse bsf bsg bsh bsi bsj bsk bsl bsm bsn bso bsp bsq bsr bss bst bsu bsv bsw bsx bsy bsz bta btb btc btd bte btf btg bth bti">To review the California Consumer Privacy Statement: Disclosures for California Residents, please visit this&nbsp;<a href="https://www.inovalon.com/privacy-policy/">link</a></span></em></p></div>