Advanced search Journal of the American Statistical Association Latest Articles Submit an article Journal homepage Full Article Figures & data References Supplemental Citations Metrics Reprints & Permissions Read this article /doi/full/10.1080/01621459.2026.2744433?needAccess=true Accepted author version Abstract The construction of most supervised learning datasets revolves around collecting multiple labels for each instance, then aggregating the labels to form a type of “true” label.