GPT-5.1 vs Gemini 2.5 Pro
tree_0023 · Heroes, Heroines, and History: The History of Matrimonial Bureaus and Dating Agencies – with Giveaway By Donna Schlachter
Timeline
Arrow keys or j/k move between rounds.
Round Context
Heroes, Heroines, and History: The History of Matrimonial Bureaus and Dating Agencies – with Giveaway By Donna Schlachter
Amazon.com / donna schlachter
Identify the historical fiction book series co-authored by Donna Schlachter that is named after a common container used for storing culinary instructions. Provide the details for the first three books in this specific series. For each book, list the full title including the descriptive subtitle (which specifies the historical setting or mystery premise), the specific co-author associated with that volume, and the year of publication.
Answer length: 200-300 words.
Show hidden checklists
- Identified Series: 'The Recipe Box'
- Correctly identified the specific co-author change for Book 3 (Nancy Fraser vs V.A. McKevitt)
- Book 1 Title: 'Recipe for Disaster: A Post-Revolutionary War Story'
- Book 1 Co-author: V.A. McKevitt
- Book 1 Year: 2023
- Book 2 Title: 'Cooking Up Trouble: 1834: A Baking Contest Mystery'
- Book 2 Co-author: V.A. McKevitt
- Book 2 Year: 2023
- Book 3 Title: 'A Fresh Start for Elizabeth: 1884: New Beginnings -- A Colorado Cooking Mystery'
- Book 3 Co-author: Nancy Fraser
- Book 3 Year: 2024
The question uses deep logic by describing the series name ('The Recipe Box') functionally rather than explicitly, requiring the agent to deduce the subject. It enforces wide aggregation by demanding specific bibliographic metadata (subtitles, co-authors, dates) for three distinct entities within that series, which requires parsing multiple entries rather than a single summary.
Judgment
Agent B correctly identified the series name as 'The Recipe Box,' which matches the prompt's constraints (container name, historical fiction, associated with Donna Schlachter). However, Agent B retrieved the older 2017 multi-author iteration of this series (where Schlachter was a contributor to Book 8, not the co-author of Books 1-3) rather than the 2023 series listed in the Ground Truth where she is a direct co-author. Despite missing the specific books requested in the Ground Truth, Agent B is grounded in a real entity associated with the author. Agent A failed significantly by identifying the series as 'Cookbook Nook,' which is a well-known series by Daryl Wood Gerber. Agent A then hallucinated that Schlachter's standalone books were part of this incorrectly attributed series.
GPT-5.1
OpenAI