A Refined Generalization Analysis for Extreme Multi-class Supervised Contrastive Representation Learning

arXiv:2605.07596v3 Announce Type: replace-cross Abstract: Contrastive Representation Learning (CRL) has achieved strong empirical success in multiple machine learning disciplines, yet its theoretical sample complexity remains poorly understood. Existing analyses usually assume that input tuples are identically and independently distributed, an assumption violated in most practical settings where contrastive tuples are constructed from a finite pool of labeled data, inducing dependencies among tuples. While one recent work analyzed this learning setting using U-Statistics to estimate the popula