Yibin Wang, Yucan Zhou, Xiaoyan Gu, Hongcheng Li, Jiang Zhou, Weiping Wang · ACM International Conference on Information and Knowledge Management (CIKM) 2026 · 2026
DOI: 10.1145/3799682.3840704
Counts differ because each database indexes a different set of publications. We treat OpenAlex as the canonical count; Google Scholar is not shown (no API, and crawling it violates its ToS).
Federated Learning is a promising paradigm to achieve privacy-preserving collaborative training. However, its performance degrades severely under data heterogeneity. A main obstacle is the divergent local representations induced by data heterogeneity, which will degrade the quality of the aggregated global representations. In this paper, we discover that although local representation spaces contain client-specific biases, their internal inter-class structure remains consistent across clients, which we identify as relative consistency. Through theoretical and empirical analyses, we further show that a proxy dataset can serve as a common anchor to translate class prototypes into a relative space, where client-specific shifts are suppressed and cross-client class centers become better aligned. Based on these findings, we propose a novel framework named Federated learning with Relative Representation Alignment (FedReRA) with Relative Knowledge Extraction (RKE) and Relative Ensemble Inference (REI) to extract and leverage the relative consistency to address data heterogeneity. Specifically, RKE debiases the prototypes by translating absolute prototypes into the aligned relative space via a flexible proxy dataset, while REI conducts collaborative inference with bias-reduced prediction in the relative space. Extensive experiments validate FedReRA's superiority over state-of-the-art methods, achieving a 3.83% average improvement under high heterogeneity and notably sustaining nearly 10% improvement on CIFAR-100 even when using random noise as the proxy data.
ACM International Conference on Information and Knowledge Management (CIKM) 2026 · 0 citations
ACM International Conference on Information and Knowledge Management (CIKM) 2026 · 0 citations
No comments yet — start the discussion below.