ML & LLM Ops Software Engineer

About the role

Spector.ai's AI-first industrial agent platform transforms plant reliability from reactive to autonomous operations. As an ML & LLM Ops Software Engineer you will own the end‑to‑end operational lifecycle of ML and LLM systems, building CI/CD pipelines, monitoring model health, and ensuring reliability in on‑prem and edge environments. Bengaluru, India – Remote work model, eligible for India‑based candidates only.

What you’ll do

• Own end‑to‑end operational lifecycle of ML and LLM systems
• Build and maintain automated CI/CD pipelines for model training, deployment, and serving
• Run quality monitoring, drift detection, and observability for production models
• Operate LLM Ops workflows including prompt versioning, evaluation, guardrails, and inference optimization
• Ensure reliability, security, and reproducibility using best‑in‑class ML Ops practices

What you’ll bring

• 3+ years in ML Ops, ML platform, or ML infrastructure engineering
• Strong experience deploying, serving, and maintaining ML models in production
• Hands‑on experience with MLflow and CI/CD automation for ML
• Proficiency with Docker and Kubernetes/K3s
• Experience with Azure, GCP, AWS and Databricks
• Experience operating LLM applications and model quality monitoring
• Strong Python software engineering fundamentals
• Ownership mindset: self‑motivated and adaptable

Skills

Education

Bachelor's degree in engineering or higher