Multi-Domain Adversarial Variational Bayesian Inference for Domain Generalization
Zhifan Gaoa b, Saidi Guoa b, Chenchu Xuc d, Jinglin Zhange, Mingming Gongf g, Javier Del Serh i j, Shuo Lik l
- aSchool of Biomedical Engineering, Sun Yat-sen University, Shenzhen, China
- bSchool of Biomedical Engineering, Sun Yat-sen University, China
- cKey Laboratory of Intelligent Computing and Signal Processing, Information Materials and Intelligent Sensing Laboratory of Anhui Province, School of Computer Science and Technology, Anhui University, Hefei, China
- dSchool of Computer Science and Technology, Key Laboratory of Intelligent Computing and Signal Processing, Information Materials and Intelligent Sensing Laboratory of Anhui Province, Anhui University, Hefei, China
- eSchool of Control Science and Engineering, Shandong University, Jinan, China
- fSchool of Mathematics and Statistics, The University of Melbourne, Parkville, VIC, Australia
- gSchool of Mathematics and Statistics, University of Melbourne, Australia
- hTECNALIA, Basque Research and Technology Alliance (BRTA), Mendaro, Spain
- iDepartment of Communications Engineering, University of the Basque Country (UPV/EHU), Spain
Papers open inside SciRah from the original publisher or repository; SciRah never hosts them.
Abstract
Domain generalization aims to learn common knowledge from multiple observed source domains and transfer it to unseen target domains, e.g. the object recognition in varieties of visual environments. Traditional domain generalization methods aim to learn the feature representation of the raw data with its distribution invariant across domains. This relies on the assumption that the two posterior distributions (the distributions of the label given the feature distribution and given the raw data) are stable in different domains. However, this does not always hold in many practical situations. In this paper, we relax the above assumption by permitting the posterior distribution of the label given the raw data changes in difference domains, and thus focuses on a more realistic learning problem that infers the conditional domain-invariant feature representation. Specifically, a multi-domain adversarial variational Bayesian inference approach is proposed to minimize the inter-domain discrepancy of the conditional distributions of the feature given the label. Besides, it is imposed by the constraints from the adversarial learning and feedback mechanism to enhance the condition invariant feature representation. The extensive experiments on two datasets demonstrate the effectiveness of our approach, as well as the state-of-the-art performance comparing with thirteen methods.

