Brian Donohue

Today we’re announcing Evals and Releases. Paired with Monitors, they give you an evaluation system for Fin, so you can test changes before they go live, roll them out with control, evaluate every live conversation, and have confidence in the experience Fin delivers. Evals tests Fin’s behavior at scale using simulated scenarios built from your own conversations.

Every update this month removed a specific constraint on what teams can do with Fin. Most Agents look impressive in demos and disappoint in production. The gap is almost always the same: complexity, control, and confidence. Can it handle the query that actually matters? Can it sound right on a call? Can your team deploy it without filing an engineering ticket? Can your managers understand what it’s doing? This month, we shipped answers to all four. Here’s what we built.

Product management is at a critical juncture – one where the traditional PM methodologies are being tested by the emerging realities of tomorrow’s technology. In the age of generative AI, the ways in which products are conceived, built, and used are being reshaped, and the role of product managers redefined.