Senior AI/ML Hardware Architect

About the role

AI and Infrastructure team at Google Cloud shapes the future of AI/ML hardware acceleration. The Senior AI/ML Hardware Architect defines next‑generation TPU architectures, develops micro‑architectural models, and partners with hardware, software, and ML teams to create high‑performance silicon solutions. Bengaluru, India, on‑site, Full‑time role with relocation assistance.

What you’ll do

• Develop architecture specifications for AI/ML roadmap
• Create power/performance micro‑architectural models
• Own micro‑architecture of compute blocks and collaborate on hardware/software codesign
• Evaluate silicon solutions and drive power, performance, area improvements
• Partner with verification, physical design, packaging, and silicon validation teams

What you’ll bring

• 8+ years architecture and micro‑architecture design of graphics or ML accelerators
• Experience with memory hierarchy, HBM, DRAM, and low‑precision/mixed‑precision numerics
• Proficiency in C++ and Python
• Experience designing networking ASICs (Ethernet/ROCE/NVlink)

Benefits

• Health insurance
• Retirement savings plan
• Paid time off

Education

Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science or related field