About the role

AI/ML Testing Team at State Street focuses on integrating generative AI into financial services. The Principal QA Engineer designs and executes test plans for Large Language Models, validates prompts, ensures safety compliance, and automates testing using Selenium, Python, and Pytest. Hyderabad, hybrid work model (remote and office).

What you’ll do

Analyze business and technical specs to create functional test cases
Execute regression and automated tests for web services and LLMs
Report, verify, and track bugs in Jira
Develop automated scripts for prompt validation and safety checks
Perform red‑team testing of LLMs for vulnerability identification

What you’ll bring

8+ years software QA testing
LLM testing experience
Python automation
Selenium with Python
Pytest framework
SoapUI or API testing
CI/CD pipeline familiarity
Jira agile management

Nice to have

Experience with BDD/TDD (Gherkin)
Familiarity with AI governance and bias detection
Hands‑on with tools like PyCharm, VS Code, Git, Postman

Skills

LLM testingPrompt validationAutomation scriptingPython SeleniumAPI testingCI/CD pipelinesJiraBDD/TDD

Benefits

Inclusive development opportunities
Flexible work‑life support
Paid volunteer days
Employee networks