Topic

AI Agent Testing

A collection of 4 issues

The multi-turn failures that prompt evals can't see

Most agent failures we see in pilots don't show up on prompt evals. Hallucinations are a genuine phenomenon and warrant testing - we also wrote about how Voxli detects them in a previous post- however, they are a visible failure which are more often than not found screenshotted

The failed Tool Call when Simulating a Customer Conversation Across Three LLMs

Recently, to assess AI Agent performance with tool calls, we executed the same multi-turn conversation across the three tiers of OpenAI's GPT-5.4: standard, mini, and nano. Our findings should make any seasoned AI developer nervous, especially if you're ‌making changes to your agent without proper

Testing for Speculation using Voxli

In our last post, we discussed the Risks of Agent Speculation. Today we will look at how you can set up Voxli to catch speculations, using a feature called Hallucination detection. Activating hallucination detection prompts Voxli to review agent dialogue and tool selections. Voxli then extracts the claims that the

The Risks of Agent Speculation

It’s no surprise that hallucinations are a common known failure during agentic AI testing. The agent starts to overpromise, begins to fabricate answers and even claims that it has taken action by stating it has ‘escalated to support’ - even when it has not. All agent builders know to