Senior Machine Learning Engineer AI Inferencing

Join ServiceNow's PLATO team as a Senior Machine Learning Engineer AI Inferencing to build AI and Machine Learning platform, collaborating with cross-functional teams to integrate AI capabilities into workflows and user experiences. Leverage expertise in Python and Golang to develop high-performance components and optimize AI models for reliability and performance.

Requirements

• Experience in leveraging or critically thinking about how to integrate AI into work processes, decision-making, or problem-solving
• Low Latency Optimization: Experience in optimizing models for low latency inference
• High Throughput Optimization: Knowledge of maximizing inference throughput
• Real-time Systems: Understanding the constraints of real-time systems on model inference
• Model Quantization and Compression: Practical experience in reducing model size and computational cost
• Proficient in prompt engineering and developing LLM based features
• Experience in using AI productivity tools such as Cursor, Windsurf, etc
• Minimum 5 years of experience working in Software Development role
• Proficiency in Python and Golang, with a strong grasp of software engineering principles
• Hands-on experience with prompt engineering: ability to craft, test, and optimize prompts for task accuracy and efficiency
• Demonstrated ability to thrive in fast-paced, dynamic environments
• Knowledge of unit testing, profiling, and code tuning

Benefits

• base pay of $158,500 - $269,500, plus equity (when applicable), variable/incentive compensation and benefits
• health plans, including flexible spending accounts
• 401(k) Plan with company match
• ESPP
• matching donations
• flexible time away plan and family leave programs