Novel Class Discovery for Long-tailed Recognition

Our method first samples a data batch including known and novel classes from the long-tailed dataset and then encodes them into an embedding space. We adopt the equiangular prototypes for representing known and novel classes, and propose an adaptive self-labeling strategy to generate pseudo-labels for the novel classes

Abstract

While the novel class discovery has recently made great progress, existing methods typically focus on improving algorithms on class-balanced benchmarks. However, in real-world recognition tasks, the class distributions of their corresponding datasets are often imbalanced, which leads to serious performance degeneration of those methods. In this paper, we consider a more realistic setting for novel class discovery where the distributions of novel and known classes are long-tailed. One main challenge of this new problem is to discover imbalanced novel classes with the help of long-tailed known classes. To tackle this problem, we propose an adaptive self-labeling strategy based on an equiangular prototype representation of classes. Our method infers high-quality pseudo-labels for the novel classes by solving a relaxed optimal transport problem and effectively mitigates the class biases in learning the known and novel classes. We perform extensive experiments on CIFAR100, ImageNet100, Herbarium19 and large-scale iNaturalist18 datasets, and the results demonstrate the superiority of our method. Our code is available at https://github.com/kleinzcy/NCDLR.

Publication
In Transactions on Machine Learning Research 2023
Chuyu Zhang
Chuyu Zhang
PhD Student

My research interests include semi-supervised learning, interactive segmentation, and Open-world learning.

Ruijie Xu
Ruijie Xu
Master Student

My research interests include Semi-supervised Learning and Self-supervised Learning.

Xuming He
Xuming He
Associate Professor

My research interests include few/low-shot learning, graph neural networks and video understanding.

Related