Evaluation Resolution Confounds Learning-Rule Comparisons in Model-Brain RSA of Early Visual Cortex
Abstract
Studies of biologically plausible learning rules (feedback alignment, predictive coding, STDP) train small networks on 32×32 images and compare them with brain responses to naturalistic stimuli presented at much higher resolution. We find that a common result in this setting, that untrained or locally trained networks rival or beat backpropagation at early visual cortex, depends on the resolution at which networks are evaluated. In representational similarity analysis (RSA) against human V1, the gap between an untrained and a backprop-trained network grows monotonically from −0.001 (95% CI $[-0.011, 0.009]$) at the 32 px training resolution to +0.030 $[0.018, 0.042]$ at 224 px (six resolutions, 5 seeds; per-subject RSA on cross-run stimulus pairs). The growth reproduces for three further learning rules, directionally in single-seed macaque electrophysiology, along training, and for an ImageNet ResNet-50 and a Swin-Tiny transformer, which also align best at low resolution although trained at 224 px. Gabor and pixel structure, the normalization state of the untrained baseline, and a global brightness statistic do not account for it. Against a criterion fixed before the analysis, limiting image content to 32 px while the input still grows does not shrink the V1 gap (+0.035 $[0.023, 0.046]$ vs. +0.030 at 224 px; ratio 1.14 $[1.03, 1.34]$): it arises once the input exceeds the training resolution, through a decline of backprop. A single luminance value per image reaches ρ= 0.054 against V1, matching the untrained network (0.053), which bounds what RSA on globally pooled features can resolve at V1 in this dataset. The one learning effect that holds across resolution is backprop above untrained at LOC. Comparisons of learning rules or architectures at early visual cortex need to control, and report, the evaluation resolution.
Related
- How Gaze Direction and Dynamics Affect Visual Resolution
- Critical Flicker Fusion Frequency As An Experience-Restricted Constraint On Visual Temporal Resolution: What Does And Does Not Change It
- Stimulus overlap confounds generalization in EEG foundation-model benchmarks
- Contributor Turnover Confounds Temporal Comparison of Recorded Habitats: A Voucher-Based Case Study of Three Lycoris Species in China from 2010 to 2020
- Comparative longitudinal evaluation of DIMS, progressive addition and single-vision lenses on myopia progression, binocular and visual performance in Spanish children
BibTeX
@misc{leutenegger2026evaluation,
title = {{Evaluation Resolution Confounds Learning-Rule Comparisons in Model-Brain RSA of Early Visual Cortex}},
author = {Nils Leutenegger},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2608.12408},
eprint = {2608.12408},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2608.12408},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Evaluation Resolution Confounds Learning-Rule Comparisons in Model-Brain RSA of Early Visual Cortex
AU - Nils Leutenegger
PY - 2026
DA - 2026/10/03
PB - arXiv
DO - 10.48550/arxiv.2608.12408
UR - https://arxiv.org/abs/2608.12408
AB - Studies of biologically plausible learning rules (feedback alignment, predictive coding, STDP) train small networks on 32×32 images and compare them with brain responses to naturalistic stimuli presented at much higher resolution. We find that a common result in this setting, that untrained or locally trained networks rival or beat backpropagation at early visual cortex, depends on the resolution at which networks are evaluated. In representational similarity analysis (RSA) against human V1, the gap between an untrained and a backprop-trained network grows monotonically from −0.001 (95% CI $[-0.011, 0.009]$) at the 32 px training resolution to +0.030 $[0.018, 0.042]$ at 224 px (six resolutions, 5 seeds; per-subject RSA on cross-run stimulus pairs). The growth reproduces for three further learning rules, directionally in single-seed macaque electrophysiology, along training, and for an ImageNet ResNet-50 and a Swin-Tiny transformer, which also align best at low resolution although trained at 224 px. Gabor and pixel structure, the normalization state of the untrained baseline, and a global brightness statistic do not account for it. Against a criterion fixed before the analysis, limiting image content to 32 px while the input still grows does not shrink the V1 gap (+0.035 $[0.023, 0.046]$ vs. +0.030 at 224 px; ratio 1.14 $[1.03, 1.34]$): it arises once the input exceeds the training resolution, through a decline of backprop. A single luminance value per image reaches ρ= 0.054 against V1, matching the untrained network (0.053), which bounds what RSA on globally pooled features can resolve at V1 in this dataset. The one learning effect that holds across resolution is backprop above untrained at LOC. Comparisons of learning rules or architectures at early visual cortex need to control, and report, the evaluation resolution.
ER -