AI Product Manager

About the role

Dscout is building the most flexible and powerful UX research platform on the market, trusted by top brands across finance, healthcare, consumer goods, and tech. As an AI Product Manager, you will lead the roadmap and strategy for a product area where the underlying model doesn't behave the same way twice, applying the full PM toolkit to AI-native products. You'll own evaluation bars, prototype and ship small AI features, make agent autonomy decisions, and partner cross-functionally across engineering, design, research, and GTM. This is a remote role based in India.

What you’ll do

• Lead the roadmap and strategy for your product area, from problem discovery through delivery and post-launch iteration
• Lead the evaluation bar for the model-powered surfaces you're responsible for: define eval sets, identify failure modes, and know the rollback plan before a change ships
• Prototype product ideas directly using your own understanding of model strengths and weaknesses, and ship small, production-quality AI features yourself when that's the fastest path to learning
• Lead product decisions about agent autonomy: what the agent should be trusted to decide and act on independently, what needs a human in the loop, and how that line should move as trust in the system g
• Treat prompting and context design as a product lever you use directly to shape behavior
• Partner with engineers on technical architecture with enough depth to challenge assumptions, propose alternatives, and influence design decisions
• Partner with Design and Research on UX so features are genuinely usable and understandable, not just technically correct
• Track the metrics that actually matter for a non-deterministic system — quality/accuracy distribution, latency, cost-per-task — alongside the usual adoption and growth metrics

What you’ll bring

• 2-5 years of product management experience owning a roadmap end-to-end, from strategy through shipped outcomes
• Direct experience shipping AI/LLM-powered features in production, including owning evaluation and quality decisions for them
• A real, hands-on feel for what different LLMs and model families are good and bad at, with the ability to prototype against that understanding
• Real technical depth: comfortable in architecture discussions and able to reason about tradeoffs (model choice, latency, cost, deterministic vs. LLM-based logic) as a peer to engineers
• Comfort defining and reasoning about eval sets and failure modes, treating quality as a property of a non-deterministic system rather than a binary pass/fail
• Experience partnering cross-functionally with Sales, Marketing, and Customer Success around releases to connect product decisions to business growth
• A high ownership mindset: treating outcomes, not deliverables, as the responsibility
• Experience shipping features within strict privacy, security, and compliance constraints — treating what the system can retain or send to a third party as a first-class product decision

Nice to have

• Experience with LLM observability/eval tooling (e.g., Braintrust, LangSmith)
• Background in a technical role (engineering, data science) before moving into product
• Experience in B2B, ideal if a market adjacent to UX/market research or insights/feedback
• Comfortable with how a lot of our AI features actually get built: fast prototypes/spikes that get real usage early, then get hardened directly into the product when they land, rather than a big-spec-f

Skills

Benefits

• A strong and competitive compensation package with a built-in bonus and equity program
• An incredible and progressive benefits package (for both you and your dependents) to support work/life balance, including flexible PTO, 15 company holidays, 12 weeks of paid parental leave, 401k match
• An education stipend to support your growth & development, and a remote work stipend
• A company that is open and transparent with our team