AI Architect Associate Director

About the role

KPMG Assurance and Consulting Services LLP is hiring an AI Architect- Associate Director in Bangalore, Karnataka, India. The role involves architecting and leading production-grade Generative AI, RAG, and Agentic AI solutions, defining reusable AI components and APIs, and mentoring junior engineers while collaborating with business and technical stakeholders. The position requires 13-16 years of AI/ML experience with at least 5 years in Generative AI and advanced AI systems.

What you’ll do

• Architect end-to-end AI/ML solutions including model selection, inference design, data pipelines, evaluation strategy, monitoring, governance, and lifecycle management
• Design and optimize RAG pipelines leveraging advanced retrieval strategies and vector databases
• Build and integrate Agentic AI frameworks for autonomous workflows and decision-making at scale
• Define architecture patterns for reusable AI components, services, APIs, and platforms
• Design and develop REST APIs for AI/ML model serving and application integration using frameworks such as FastAPI or Flask
• Design architectures addressing scalability, availability, latency, reliability, fault tolerance, security, cost optimization, maintainability, and observability
• Define MLOps/LLMOps processes for model versioning, prompt versioning, evaluation pipelines, model registry, and production monitoring
• Collaborate with leadership to shape AI strategy, roadmap, and technical standards, and mentor junior engineers on AI/ML development and deployment

What you’ll bring

• Bachelor's or Master's degree in Computer Science, AI/ML, or related field
• 13-16 years of experience in AI/ML development
• At least 5 years in Generative AI and advanced AI systems
• Expert-level proficiency in Python with strong software engineering fundamentals
• Proven experience with Agentic AI solutions, RAG, fine-tuning, and production deployment
• Hands-on experience with agentic AI frameworks such as LangChain, AutoGen, or Semantic Kernel
• Strong experience in REST API development, microservices, and enterprise system design
• Experience with AWS, Azure, or GCP and MLOps/LLMOps practices including CI/CD, Docker, and Kubernetes

Nice to have

• Azure experience with Azure OpenAI, Azure ML, Azure AI Search, AKS, Blob Storage, Key Vault, and Application Insights
• Exposure to advanced agent orchestration, tool calling, workflow automation, multi-agent patterns, and guardrails
• Familiarity with data engineering concepts such as ETL/ELT, SQL/NoSQL, Spark, Databricks, metadata management, and unstructured data pipelines

Skills

Education

Bachelor’s or Master’s degree in Computer Science, AI/ML, or related field.