evidence boundary
unknowncomputational
An evidence atom is an inspectable support unit. It is not a finding by itself; it supports or challenges a finding through review.
frontiers / frontier
Evidence atom
back to sourcesevidence boundary
unknownAn evidence atom is an inspectable support unit. It is not a finding by itself; it supports or challenges a finding through review.
finding binding
boundInduction-head redundancy is not universal across scale: in pythia-70m individual heads remain load-bearing, with single-ablation deltas of 0.61 (L3H6, 12% of group), 0.58 (L3H5, 12%), and 1.22 (L3H1, 25%) against a group delta of 4.949 — a cooperative rather than purely-redundant circuit, contrasting the heavy redundancy seen in the larger GPT2-family and pythia-160m models.
inspect finding →
source binding
source-boundvs_2a6614cf8c092119
inspect source →
review context
unverified2 reviewable changes and 0 evaluation records target this atom or its bound objects.
Evidence statement
Induction-head redundancy is not universal across scale: in pythia-70m individual heads remain load-bearing, with single-ablation deltas of 0.61 (L3H6, 12% of group), 0.58 (L3H5, 12%), and 1.22 (L3H1, 25%) against a group delta of 4.949 — a cooperative rather than purely-redundant circuit, contrasting the heavy redundancy seen in the larger GPT2-family and pythia-160m models.
extraction method
manual_curation
support relation
unknown
condition refs
vcnd_d3cb629eca90495e
Caveats
events
vev_803223185cc9c144finding.assertedManual finding added to frontier state
agent:replicator · 2026-05-29
vev_e6556beb3ac94e15finding.caveatedVerifier caution: The scaling hypothesis—that redundancy is not universal and smaller models show load-bearing heads—is interesting but unverified. The finding presents the pythia-70m vs pythia-160m difference as fact based on a single task (repeated tokens). The 25% vs <1% split suggests a real e
reviewer:will-blair · 2026-05-29
reviewable changes
vpr_fa16be3ca10509c9finding.addManual finding added to frontier state
applied · agent:replicator · 2026-05-29
vpr_cbe6ab24fc274f43finding.caveatVerifier caution: The scaling hypothesis—that redundancy is not universal and smaller models show load-bearing heads—is interesting but unverified. The finding presents the pythia-70m vs pythia-160m difference as fact based on a single task (repeated tokens). The 25% vs <1% split suggests a real e
applied · reviewer:will-blair · 2026-05-29
evaluations
No evaluation rows are attached.