Where Jev breaks, and how fast it answers

Jev answers typed questions with probabilities. It does not write text. Below are real answers we recorded from , replayed from disk. Nothing on this page calls the API.

measured Questions and ground truth written by us, one phrasing per case. Directional, not a benchmark.

1. Ask it something with a known answer

Each bar is the probability Jev gave for "yes". The line marks 0.5. Pick a group.

2. The fix for counting: ask per item, add in code

Instead of "are there exactly twelve fruits?", ask one yes/no question per item in a single call and count the answers above 0.5 yourself.

3. Latency by number of questions in one call

Every dot is one request on a warm connection. The tick is the median. Log scale.