Domain Adaptation with Conditional Distribution Matching and Generalized Label Shift

In this paper, we propose a new assumption, generalized label shift (GLS), to improve robustness against mismatched label distributions

Released in: Domain Adaptation with Conditional Distribution Matching and Generalized Label Shift

Source: Microsoft Research

Contributor:

by

Summary

limitations of this approach when label distributions differ between the source and target domains. In this paper, we propose a new assumption, generalized label shift (GLS), to improve robustness against mismatched label distributions. GLS states that, conditioned on the label, there exists a representation of the input that is invariant between the source and target domains. Under GLS, we provide theoretical guarantees on the transfer performance of any classifier. We also devise necessary and sufficient conditions for GLS to hold, by using an estimation of the relative class weights between domains and an appropriate reweighting of samples. Our weight estimation method could be straightforwardly and generically applied in existing domain adaptation (DA) algorithms that learn domain-invariant representations, with small computational overhead. In particular, we modify three DA algorithms, JAN, DANN and CDAN, and evaluate their performance on standard and artificial DA tasks. Our algorithms outperform the base versions, with vast improvements for large label distribution mismatches.

A video of the talk: https://slideslive.com/38936767/domain-adaptation-with-conditional-distribution-matching-and-generalized-label-shift?ref=speaker-17549-latest

2020

Year Released

Key Links & Stats

microsoft/Domain-Adaptation-with-Conditional-Distribution-Matching-and-Generalized-Label-Shift

Paperwork link title

Domain Adaptation with Conditional Distribution Matching and Generalized Label Shift

Huggingface Link

@inproceedings{tachet2020domain, title={Domain Adaptation with Conditional Distribution Matching and Generalized Label Shift}, author={Tachet des Combes, Remi and Zhao, Han and Wang, Yu-Xiang and Gordon, Geoff}, year={2020}, booktitle={Advances in Neural Information Processing Systems} }

ML Tasks

  1. Autonomous Vehicles
  2. Batch Normalization
  3. Depth Estimation
  4. Face Animation

ML Platform

  1. Pytorch

Modalities

  1. Still Image
  2. 3D Asset
  3. LiDAR

Verticals

  1. Facial
  2. AR/VR
  3. Medical

CG Platform

  1. Blender
  2. NVIDIA Omniverse
  3. Unity

Related organizations

Microsoft