RICO Citation Verification Report
This is a substantive revision, not a reissue. Report versions v1.0 and v1.1 verified RICO v3.8 and v5.7 respectively. Those versions were previously described as permanently locked to the manuscript version they verified. That lock has been lifted by PCP decision of 2026-08-08, on the ground that the lock governs which manuscript version a report verifies, not whether the report’s findings are correct, and v1.1 contained an error that could not be corrected without re-issuing.
The error: v1.1 recorded C2 (Olsson et al., 2022) as verified with no fabrication detected, and dispositioned it KEEP. The RICO reference at that time listed an author, “Rai, A.”, who does not appear anywhere in the source, and gave DasSarma the wrong initial. The v1.1 record shows the verifier encountered the discrepancy and produced an unparseable note about it rather than assigning the AMBIGUOUS rating that CVP Section 5 Part C requires when support cannot be confidently determined. The certification statement issued on that basis was therefore inaccurate as to C2.
This version re-runs the full protocol against RICO v6.3, in which the reference has been corrected. The failure is documented rather than quietly repaired, because a demonstration artifact for a verification protocol is more useful to a practitioner when it shows the protocol’s real failure mode than when it shows only a clean pass.
1. Live Retrieval Access Confirmation
Per SF0037 v1.4 Section 4.1. Live access confirmed prior to verification. Full text was retrieved for every citation; no citation was assessed from abstract or metadata alone.
| URL Opened | Content Confirmed | Status |
|---|---|---|
| arxiv.org/abs/2005.14165 | Brown et al. (2020) landing page; 31-author byline and v4 submission history retrieved. | LIVE |
| arxiv.org/pdf/2005.14165 | 75-page full text extracted; few-shot definition located at p.6. | LIVE |
| transformer-circuits.pub/2022/in-context-learning… | Full HTML retrieved (124,410 characters of body text); byline and induction-head definition confirmed. | LIVE |
| aclanthology.org/2024.tacl-1.9.pdf | 17-page TACL full text; lost-in-the-middle finding located at p.1. | LIVE |
| arxiv.org/pdf/2404.06654 | 27-page RULER full text; context-length degradation results located at p.1. | LIVE |
| arxiv.org/pdf/2309.17453 | 21-page ICLR 2024 full text; attention-sink mechanism located at p.1. | LIVE |
| doi.org/10.5281/zenodo.18289391 | Concept DOI resolved to record 19155138 (CRD v1.6); PDF openly downloadable. | LIVE |
2. Citation Inventory
Per SF0037 v1.4 Section 4.2. Total citations in RICO v6.3: N = 6.
| ID | Reference | Cited In | Access Class |
|---|---|---|---|
| C1 | Brown et al. (2020) | 5.3 | FREE-FULLTEXT |
| C2 | Olsson et al. (2022) | 5.3, 7.2 | FREE-FULLTEXT |
| C3 | Liu et al. (2024) | 1.2 | FREE-FULLTEXT |
| C4 | Hsieh et al. (2024) | 1.2 | FREE-FULLTEXT |
| C5 | Xiao et al. (2023) | 7.3 | FREE-FULLTEXT |
| C6 | Gantz (2026) SF0039 | References only | FREE-FULLTEXT |
3. Individual Citation Verification Records
4. Verification Summary
| Metric | Result |
|---|---|
| Total citations inventoried (N) | 6 |
| Citations fully processed | 6 / 6 |
| Citations passing PVC (FREE-FULLTEXT) | 6 (C1–C6) |
| Citations mapped to a manuscript claim | 5 (C1–C5); C6 unmapped |
| Citations rated FULL SUPPORT | 5 (C1–C5), across six claim mappings |
| Citations failing Section 4.4 claim-map requirement | 1 (C6) |
| Citations removed or replaced | 0 (one pending PCP decision) |
| Fabricated author names detected and corrected | 1 (C2, corrected in manuscript v6.3) |
| Prior-report findings superseded | 2 (C2 disposition; C6 PVC flag cleared) |
| Bibliographic style notes recorded | 1 (C1 truncation without ellipsis) |
| Verification Tier achieved | Tier 1 (Single-Platform Verified) with PAR records |
Tier note, stated plainly. SF0037 Section 7 sets Tier 2 (dual-platform verification) as the default for public release. This run achieved Tier 1: each citation was verified against one authoritative first-party source with full text opened and evidence anchors captured, and PAR persistence records were recorded for all six. Independent second-repository confirmation was not performed for every citation. The honest tier is therefore Tier 1 with PAR, not Tier 2. Report v1.1 claimed Tier 2 on the basis of dual confirmation for two of six citations, which overstated the tier; that claim is superseded.
I certify that I executed SF0037 CVP v1.4 using live retrieval against public sources. Full text was opened for every citation; no support rating was assigned from an abstract, from metadata, or from model priors.
Total citations inventoried: N = 6 | Citations fully processed: 6 / 6 | Citations retained: 5 unconditional (C1–C5) + 1 pending PCP disposition (C6) | Citations removed or replaced: 0 | Verification tier achieved: Tier 1 with PAR | Verification completed: August 8, 2026
Verifier: Claude Opus 4.6 (claude-opus-4-6), Anthropic | Prepared by: Thomas W. Gantz, Synthience Institute
5. Recommendations for Publication
1. C6 (Gantz 2026, CRD, SF0039) — action required. The citation satisfies PVC but fails the Section 4.4 claim-map requirement. Two dispositions are available and the choice is a PCP decision. Remove it from the reference list, which costs nothing evidentially since no claim rests on it. Or reattach it by adding an inline citation at a point where RICO’s argument genuinely draws on context representation drift; Section 1.2, which surveys long-context literature, is the natural site. Reattachment is the stronger option if and only if the manuscript actually uses the source; adding an inline citation solely to legitimise a reference-list entry would invert the requirement.
2. C1 (Brown et al. 2020) — optional style correction. The seven-name list is a truncation of a 31-author byline presented without an ellipsis. All named authors are correct. No integrity issue and no urgency.
3. C2 (Olsson et al. 2022) — closed. The fabricated author and the incorrect initial are corrected in RICO v6.3 and verified against the source byline.
4. C3 (Liu et al. 2024) — closed. The final TACL citation replaced the preprint numbering per the v1.1 recommendation.
5. Tier upgrade before deposit. A second independent repository confirmation per citation would achieve the Tier 2 default that SF0037 Section 7 sets for public release.
6. On the value of this report as a demonstration artifact. Report v1.1 was published to show what CVP output looks like. It now also shows what a verification failure looks like from the inside: a verifier that retrieved the correct source, encountered a name it could not place, wrote a fluent sentence that resolved nothing, and passed. Section 5 Part C already prescribes the correct behaviour, which is to rate AMBIGUOUS and treat it as failure. The gap was not in the protocol but in its execution, and the class of error is one an automated author-list comparison cannot commit, since a name either appears in the retrieved byline or it does not. Practitioners running CVP should treat any author-name discrepancy as AMBIGUOUS until resolved by direct string comparison against the retrieved source.