Verified today
Senior QA Engineer
About the role
JazzX AI is building an AGI-first platform that transforms enterprise knowledge work. We seek a Senior QA Engineer to lead the quality strategy for AI-powered products, overseeing a team of QA engineers and automation specialists. The role blends traditional QA expertise with AI/ML awareness, driving quality from design through release. Responsibilities include defining QA strategy, developing evaluation systems for LLM accuracy and safety, architecting automation frameworks, performing performance testing, and ensuring release readiness. Candidates should have 5+ years of software QA experience, strong automation skills in Python/Java/JS, microservice architecture knowledge, and familiarity with AI/ML systems. This full‑time, on‑site position in Bengaluru offers the chance to shape quality for a cutting‑edge AI platform.
What you’ll do
- Define and own end‑to‑end QA strategy for AI copilots and workflows.
- Lead, mentor, and scale QA engineering team.
- Partner with Product, ML, and Platform Engineering on quality in design.
- Develop evaluation systems for LLM accuracy, safety, and bias.
- Architect automation frameworks and integrate into CI/CD pipelines.
- Conduct performance testing (load, stress, endurance) with industry tools.
- Own release sign‑off, RCA, and continuous improvement of QA lifecycle.
- Monitor model drift and post‑production behavior with DevOps/ML Ops.
What you’ll bring
- 5+ years in Software QA.
- Hands‑on test automation (Python/Java/JS).
- Experience with microservice architecture.
- Knowledge of AI/ML systems and LLM evaluation.
- Strong analytical and problem‑solving skills.
Nice to have
- LLM, RAG, or autonomous AI agent testing experience.
- Familiarity with AI observability tools (ELK, Prometheus, Datadog).
- Exposure to security, performance, and compliance testing (SOC2, GDPR).
- Ability to thrive in fast‑paced startup environment.