Domain-Specific Batch Normalization for Unsupervised Domain Adaptation

A novel unsupervised domain adaptation framework based on domain-specific batch normalization in deep neural networks

Released in: Domain-Specific Batch Normalization for Unsupervised Domain Adaptation

Source: Domain-Specific Batch Normalization for Unsupervised Domain Adaptation

Contributor:

Summary

Author proposes a novel unsupervised domain adaptation framework based on domain-specific batch normalization in deep neural networks to adapt to both domains by specializing batch normalization layers in convolutional neural networks while allowing them to share all other model parameters, which is realized by a twostage algorithm. In the first stage, pseudolabels for the examples in the target domain are estimated using an external unsupervised domain adaptation algorithm—for example, MSTN or CPUA —integrating the proposed domain-specific batch  normalization. The second stage learns the final models using a multi-task classification loss for the source and target domains. Note that the two domains have separate batch normalization layers in both stages.

Framework can be easily incorporated into the domain adaptation techniques based on deep neural networks with batch normalization layers. We also present that our approach can be extended to the problem with multiple source domains. The proposed algorithm is evaluated on multiple benchmark datasets and achieves the state-of-theart accuracy in the standard setting and the multi-source domain adaption scenario.

2019

Year Released

Key Links & Stats

wgchang / DSBN

Domain-Specific Batch Normalization for Unsupervised Domain Adaptation

Domain-Specific Batch Normalization for Unsupervised Domain Adaptation

@misc{https://doi.org/10.48550/arxiv.1906.03950, doi = {10.48550/ARXIV.1906.03950}, url = {https://arxiv.org/abs/1906.03950}, author = {Chang, Woong-Gi and You, Tackgeun and Seo, Seonguk and Kwak, Suha and Han, Bohyung}, keywords = {Machine Learning (cs.LG), Artificial Intelligence (cs.AI), Machine Learning (stat.ML), FOS: Computer and information sciences, FOS: Computer and information sciences}, title = {Domain-Specific Batch Normalization for Unsupervised Domain Adaptation}, publisher = {arXiv}, year = {2019}, copyright = {arXiv.org perpetual, non-exclusive license} }

ML Tasks

  1. Domain Adaptation

ML Platform

  1. Pytorch

Modalities

  1. General

Verticals

  1. General

CG Platform

  1. Not Applicable

Related organizations

Computer Vision Lab., ECE & ASRI, Seoul National University, Korea

Computer Vision Lab., CSE, POSTECH, Korea