Vice President, AI/ML Engineering

About the role

Goldman Sachs seeks a Vice President of AI/ML Engineering to lead the Production Runtime Experience team within Enterprise Technology Operations. The role focuses on designing and deploying agentic AI solutions that automate production monitoring, incident response, and cost‑optimization across the firm’s large‑scale compute infrastructure. The incumbent will build robust LLM‑powered agents, develop evaluation frameworks, integrate with observability and incident‑management systems, and collaborate with production engineers to translate operational pain points into AI roadmaps. Strong expertise in Python, large‑scale distributed systems, and cloud‑native infrastructure (AWS) is required, along with deep knowledge of LLM APIs, prompt engineering, and RAG pipelines. The position demands 7+ years of applied data science or ML engineering experience, 3+ years of production ML system design, and a proven track record of delivering reliable, scalable AI services. As a senior leader, the VP will mentor peers, drive design reviews, and ensure compliance with safety and governance standards. The role offers a competitive base salary of $150k–$250k, discretionary bonuses, and comprehensive benefits for full‑time employees.

What you’ll do

• Design agentic AI systems for production
• Build evaluation framework for LLMs
• Integrate agents with observability and incident systems
• Collaborate with production engineers to define AI roadmaps
• Ensure safety, compliance, and governance
• Optimize cost and latency of AI services
• Mentor peers and drive design reviews

What you’ll bring

7+ years applied data science/ML engineering experience

Nice to have

• 7+ years software dev in Python/C/C++/Go/Java
• 3+ years production ML system design
• Experience with LLM APIs, prompt engineering, RAG
• Cloud infra (AWS) and IaC expertise

Skills

Benefits

• Health, dental, vision insurance
• 401(k) matching
• Paid time off
• Wellness programs

Education

Bachelor's in CS/Applied Math/Engineering; Masters/PhD preferred