Sonar Pro vs Claude Opus 4.1
tree_0003 · The 17 best photography websites
Timeline
Arrow keys or j/k move between rounds.
Round Context
The 17 best photography websites
The best camera phones – tried and tested by a photographer
Identify the digital creativity and design website that published the article titled 'The 17 best photography websites'. Search within that specific publication to find a guide dedicated to mobile photography hardware. Provide the exact, full headline of this guide, which explicitly states that the devices were 'tried and tested by a photographer'.
Answer length: 50-100 words.
Show hidden checklists
- Identifies the source publication as 'Creative Bloq'
- Target Article: 'The best camera phones – tried and tested by a photographer'
- Retrieves the exact headline of the camera phone article
- Includes the phrase 'tried and tested by a photographer' in the answer
The question requires Deep reasoning to identify the specific publisher (Creative Bloq) using the title of one article ('The 17 best photography websites'). It then applies Wide aggregation by requiring the agent to search that specific domain for a second, distinct entity (the camera phone guide) based on a specific string match condition found in the target title.
Judgment
Both agents correctly identified the publication as 'Creative Bloq'. However, Agent B followed the negative constraint to provide the 'exact, full headline' much more accurately. Agent A hallucinated the phrase 'for creatives' into the title, which does not exist in the actual article headline. Agent B correctly retrieved the current live headline (including the year 'in 2024'). Agent B also provided better context and standard citation numbering.
Sonar Pro
Perplexity
Claude Opus 4.1
Anthropic