A frozen suite of 1,000 six-max, 100bb cash-game composite quizzes for evaluating model decisions against stored GTO answer data. Every listed model completed the same V1 quiz set.
All listed models completed the same 1,000 V1 quizzes. The ranking is sorted by the selected metric.
Evaluation Protocol: Quizzes are drawn deterministically from frozen composite manifests. The model follows its own action path across preflop, flop, turn, and river.
Ground-Truth Isolation: Model prompts strictly exclude action IDs, opponent hole cards, quality labels, EV loss values, or GTO score indicators.
Score Scope: Average GTO score and EV loss include scored decisions along each model’s action path.
Frozen set of 1,000 quizzes
6 positions · 3 starting spots
Legal choices match the run format
No opponent cards or scores
Preflop → Flop → Turn → River
Each model chooses its own path
Stored EV loss for each answer
Quality-based GTO score
A deterministic seed fixes the quiz selection. The 1,000-quiz manifest balances six table positions (166–167 each) and three preflop starting spots: First Raise In (333), Facing Open (333), and Facing 3-Bet (334).
The model chooses its own path through each action tree. A preflop fold can end the hand; continuing can lead to flop, turn, and river decisions.
Each chosen answer carries a quality label and EV loss. The reported GTO score combines its quality tier with normalized EV loss; average EV loss is reported separately in big blinds per scored decision.
Each card opens one decision sampled from the frozen V1 quiz set. These cards illustrate situations; they do not report per-spot model performance.
Decide whether to open a hand from early position at a six-player table.
Choose an opening action from late position after earlier players fold.
Choose whether to complete, raise, or fold when action reaches the small blind.
Face a cutoff raise in the big blind and choose whether to fold, call, or 3-bet.
Face an early-position open with a suited wheel ace and choose a response.
An UTG opener faces a button 3-bet and must choose between folding, calling, and 4-betting.
After raising over a small-blind limp, choose whether to check or bet a paired flop.
After a flop bet is called, choose whether to check or bet again on a paired turn.
After both players check flop and turn, choose whether to check or value bet the river.
Simple mean across all listed models. Later-street scores cover only decisions each model reached.
This benchmark preview does not yet have a stable public URL. Update the citation when the benchmark page is published.