Charli Idrac
“My agent never answers the same way twice”
Charli Idrac · Loire Room · 10:20 · 40 min
“My agent never answers the same way twice”
An in-house AI Factory for a deterministic, testable, reliable agent. From data science to AIOps
On Brevo’s customer support, a ticket that is 70% good is a zero ticket. That threshold put the promise of autonomous agents to the test, and broke it. This case study explains how the team started over from scratch, and why the reliability of an agent in production often runs counter to what agentic AI promises.
But the agent story is only a pretext: this talk is really about capturing the impact of AI in operations, on the ground and on the bottom line. Along the way, the team achieved a 5x productivity gain, completely rethought its team roles, and raised support team productivity by 40%.