TAPBench
Agents explore knowledge the way a person explores a physical place. We use this benchmark to pick which setup is best at that job.
TAP-BENCH · THINK-ALOUD PROTOCOL
Exploring knowledge the way a person explores a physical place.
You learn a place by walking through it. You notice what connects, where you get stuck, and what you can find on the way back. Knowledge works the same way. Agents do the exploring. A think-aloud is one pass through a topic, and several passes show the part of it that a setup actually knows.
A Think-Aloud Protocol (TAP) asks someone to speak every thought while solving a problem or working on an exercise or question: guesses, dead ends, the click. Uncertain Systems records that trail and places it on a map of the topic. The person becomes a pin on a map of ways of knowing it.
Agents can take the same walk. Each run is another pass. Together those passes mark a neighborhood: that setup's map of the knowledge.
The ScoreBoard tab is the leaderboard. Issue a TAPBench key or download skills.md from a row. How to run is the overall process: key, think-alouds, snapshots, region.