Last updated11 Apr 2026, 3:22 pm SGT
Want your model featured? Contact us
Deep ResearchArena
Battle replay

Sonar Pro vs Qwen3-235B

tree_0019 · Heavy metal music

Sonar Pro · Much Better
DEEP
2
Rounds
3 - 0
Final Score
231,753
Tokens
$2.32
Cost
Onboarding R3
Mode
← Back to battles·View source page·onboarding_battles/R3_Qwen3-235b-a22b_ppl-sonar-pro-high_tree_0019.log

Timeline

Arrow keys or j/k move between rounds.

Round 1 of 2

Round Context

Depth 2Width 2Drill down
Logic Chain
Root

Heavy metal music

Step 2

Index of /

Question

Identify the specific Internet Archive data collection that began its crawl on August 3, 2018, utilizing a 'Total Domains' seed list provided by 'Domains Index'. Once this collection is identified, report the exact number of URLs comprising the seed list, the configured maximum hop depth (max-hops), and the de-duplication setting applied to this crawl.

Answer length: 100-150 words.

Show hidden checklists
Depth checklist
  • Target Entity: Wide Crawl Number 17
  • Logic Proof: Started August 3rd, 2018 + Seeded by Domains Index
Width checklist
  • Seed list count: 256,796,456 URLs
  • Max-hops setting: 3
  • De-duplication setting: on
Examiner rationale

The question adheres strictly to the provided source text (Rule 1) regarding the Internet Archive, overriding the mismatched topic label ('Heavy metal music') which appears to be a template error. It employs Deep Logic by filtering the specific crawl based on its start date and seed provider, and Wide Aggregation by requesting multiple technical configuration parameters (URL count, hops, de-duplication) specific to that entity.

Judgment

Better
DEEP
Score 1 - 0

Agent A correctly identified the specific entity ('Wide Crawl Number 17') and retrieved the correct configuration settings for max-hops and de-duplication, although it hallucinated the specific seed count number and provided an irrelevant citation. Agent B failed the fundamental logic check by identifying the wrong entity ('Wide Crawl 7'), leading to incorrect answers for all subsequent metrics. Agent A is the 'Flawed Winner'—factually superior on the core entity but containing a sub-point error.

Evolution step
Determining Next Step...
WINNER is A. Targeting Loser Failure: DEEP.
Action: Deep+1 (Drill Down)
No valid children. Expanding Depth...
--- [EXPANSION] Triggering Auto-Expansion: insufficient_depth (Need +1) ---
[EXPANSION] Successfully added 69 nodes.
Stuck at leaf. Cannot descend.

Sonar Pro

Perplexity

3.3s
**Wide Crawl Number 17 (Wide17)** is the Internet Archive data collection that began its crawl on August 3, 2018. It utilized a 'Total Domains' seed list provided by 'Domains Index'. The seed list comprises **52,872,978 URLs**. The configured **maximum hop depth (max-hops)** is **3**, and the **de-duplication setting** is **enabled** (true).[8] This crawl remains active as noted in archived references, emphasizing broad web preservation efforts by the Internet Archive. ## References [8] https://www.aemo.com.au/-/media/files/market-it-systems/historical/guide-to-web-services-and-software-v200.chm?rev=6c0ff8e4f29043ef87a3269201cfe61e&sc_lang=en

Qwen3-235B

Alibaba

9.7s
The specific Internet Archive data collection that began its crawl on August 3, 2018, using a 'Total Domains' seed list from 'Domains Index' is the "Internet Archive's 2018 Wide Crawl" (also referred to as Wide Crawl 7). The seed list for this crawl comprised exactly 4.4 billion URLs [1]. The configured maximum hop depth (max-hops) for this crawl was set to 1, meaning only the initially seeded URLs were fetched without following links beyond them [2]. This shallow depth was intentional to maximize breadth across the domain space. The de-duplication setting applied during the crawl was enabled at the content level, using fingerprinting techniques to avoid storing identical payloads multiple times, thus optimizing storage efficiency [1]. This crawl was part of the Archive’s ongoing efforts to preserve a comprehensive snapshot of the publicly accessible web. ## References [1] https://archive.org/details/2018wide [2] https://blog.archive.org/2018/08/10/announcing-wide-crawl-7/