SmarTek21

SDET Automation Engineer AI

ServiceNow Role Type:
ServiceNow Modules:
Department - JobBoardly X Webflow Template
DevOps
Department - JobBoardly X Webflow Template
Governance, Risk, and Compliance
ServiceNow Certifications (nice to have):

Job description

Date - JobBoardly X Webflow Template
Posted on:
 
October 31, 2025

SmarTek21 is seeking a highly skilled Senior QA Engineer/Lead with experience in testing Generative AI and Agentic AI solutions. The role involves ensuring the quality, reliability, and performance of AI-powered capabilities, including autonomous agents and conversational experiences. The candidate will work closely with cross-functional teams to define testing strategies and implement AI-aware automation frameworks.

Requirements

  • 8+ years of experience in QA with 2+ years of testing Generative AI / Agentic AI / ML-based systems
  • Hands-on experience validating AI workflows in one or more enterprise ecosystems such as ServiceNow, Oracle Fusion, or cloud-native platforms
  • Strong scripting and automation skills (Python preferred) with experience in frameworks like Selenium, Playwright, REST Assured, or PyTest
  • Knowledge of LLM architectures, NLP behavior, RAG workflows, and vector retrieval validation
  • Proficiency with Git, CI/CD pipelines, Docker/Kubernetes for enterprise automation support
  • Expert in QA including test design, defect lifecycle, and quality metrics
  • Knowledge of Responsible AI, bias/fairness testing, and governance practices
  • Strong communication skills

Requirements Summary

8+ years QA exp with AI testing. 2+ years GenAI/AI/ML system testing. Strong scripting skills & automation. LLM & RAG knowledge is required