Senior Machine Learning Engineer AI Inferencing

ServiceNow is seeking a Senior Machine Learning Engineer to join their AI and Machine Learning (ML) platform at the Santa Clara office. The role involves building and optimizing a high-performance inferencing platform to drive enterprise service efficiency, utilizing Python and Golang. Collaboration with cross-functional teams is key, with a focus on reliability, performance, and user experience.

Requirements

• Experience in leveraging or critically thinking about how to integrate AI into work processes, decision-making, or problem-solving.
• Low Latency Optimization
• High Throughput Optimization
• Real-time Systems Understanding
• Model Quantization and Compression
• Proficient in prompt engineering and developing LLM based features
• Experience in using AI productivity tools such as Cursor, Windsurf, etc.
• Minimum 5 years of experience working in Software Development

Benefits

• Health plans
• Equity (when applicable)
• Variable/incentive compensation
• Flexible spending accounts
• Company match for 401(k) Plan
• Employee EspP
• Matching donations
• Flexible time away plan
• Family leave programs