GLM-4.7 vs Kimi K2
tree_0001 · Video rental shop
Timeline
Arrow keys or j/k move between rounds.
Round Context
Video rental shop
Google Search
Consult 1984 newspaper archives to locate information on two specific video rental businesses. The first business was the site of a police standoff on Airport Highway where a suspect named Robert McCloud surrendered after wielding an M-16 rifle. The second business was profiled in late December 1984, located in Butterfield Village (Chino Valley), and owned by Maggie and Harry Williams. For the first business, provide the specific street address (number and street). For the second business, provide the full business name and the specific type of non-video hardware they sold, installed, and serviced.
Answer length: 100-150 words.
Show hidden checklists
- Correctly identifies the Toledo Blade (or similar source) incident involving Airport Video Rentals and Robert McCloud.
- Correctly identifies The Courier (or similar source) profile on Maggie and Harry Williams in Chino Valley.
- Street Address for the first shop: 6936 Airport Hwy (or Highway)
- Business Name for the second shop: Video Shoot Satellite Systems
- Additional Services for the second shop: Selling, installing, and servicing satellite dishes
The question utilizes Deep reasoning by anchoring the search to a specific year (1984) and unique, non-obvious identifiers (Robert McCloud/M-16 and Maggie & Harry/Butterfield Village) found in historical newspaper scraps. It requires Wide aggregation by demanding distinct attributes (a street address from one document and a business name/service description from a completely different document) that cannot be answered by a single source.
Judgment
Agent A failed to generate a response, outputting only the search queries (a 'crash' or failure to execute). Agent B provided a structured, readable response with citations. However, Agent B is capped at 'Better' rather than 'Much Better' because it failed the specific Ground Truth accuracy checks. It provided the wrong address for the first business (5230 vs 6936 Airport Hwy) and the wrong name for the second business ('Butterfield Video' vs 'Video Shoot Satellite Systems'), likely hallucinating details or conflating entities. Despite these errors, Agent B is the winner because it provided a functional attempt with correct context (satellite dishes, correct owners, correct events), whereas Agent A provided zero utility.
GLM-4.7
Zhipu AI
Kimi K2
Moonshot AI