How we actually know our AI agents are getting better?
Everyone says agent quality is up. Here is how we measure it at Klarent, and what our numbers show.
Finance & banking
QA for banks, fintechs, and payments
Insurance & claims
QA for carriers, brokers, and insurtech
Media & entertainment
QA for publishers and streaming
Retail & eCommerce
QA for storefronts, cart, and checkout
SaaS Apps
QA for multi-tenant B2B software
Travel & Hospitality
QA for booking, GDS, and reservations
About
Kirill Shakhnovich is an Applied AI Engineer at Klarent, with an MSc in Data Science from ETH Zürich (GPA 5.8/6.0, with distinction). His master's thesis introduced a method for generating synthetic queries with LLMs to evaluate and train product search models, replacing costly A/B testing. He previously worked as a Data Science Intern at the Singapore-ETH Centre, building predictive models for bioconversion research, and spent over four years as a Teaching Assistant at ETH Zürich.
Articles by Kirill Shakhnovich
1 published