Machine Learning Quality Engineer

ServiceNow is seeking a Machine Learning Quality Engineer to join their Conversational AI team. The ideal candidate will have experience in quality assurance and/or application development, strong test automation skills in Java/Python, and hands-on experience testing large-scale production systems. The role involves working on Machine Learning technologies, testing AI/ML models, and collaborating with developers to design testing strategies.

Requirements

• Experience in quality assurance and/or application development
• Strong test automation skills in Java / Python
• Hands-on experience testing large-scale, production systems in Python or Java
• Excellent communication, reporting and problem-solving skills
• Ability to take a project from scoping the requirements and building the test cases
• Maintain existing automation test frameworks
• Familiarity with testing AI/ML models and evaluation of the model quality
• Ability to review results from the test set and create defects based on result patterns
• Work with developers to design specific testing strategies for features being developed and automate them
• Create comprehensive test plans; execute and automate them
• Partner with the engineering organizations in troubleshooting or addressing issues with applications and dev/test environments
• Experience in leveraging or critically thinking about how to integrate AI into work processes, decision-making, or problem-solving
• 2+ years of experience with technologies relevant to SN, Quality engineering and coding skills with high-quality results
• 2 years of experience as a Machine Learning Quality Engineer
• Bachelor's degree and a minimum of 2 years of related experience; or an advanced degree without experience; or equivalent work experience
• Experience working within different automated testing frameworks, including Java, JUnit, Python, Selenium, TestNG and other open-source projects
• Experience with the agile methodology for software development teams
• Ability to know several testing techniques (e.g. performance, unit, integration, automated), their strengths and weakness, and ability to use them to best effect - including tracking and addressing of any discovered issues
• Ability to use tools (such as IDE, debugger, build tools, source control, ServiceNow instances, profilers, system administration/Unix tools) to assist with daily tasks

Benefits

• health plans, including flexible spending accounts
• a 401(k) Plan with company match
• ESPP
• matching donations
• a flexible time away plan
• family leave programs