CyCADA: Cycle-Consistent Adversarial Domain Adaptation

A discriminatively-trained Cycle-Consistent Adversarial Domain Adaptation model that adapts representations at both the pixel-level and feature-level, enforces cycle-consistency while leveraging a task loss, and does not require aligned pairs

Released in: CyCADA: Cycle-Consistent Adversarial Domain Adaptation

Source: CyCADA: Cycle-Consistent Adversarial Domain Adaptation

Contributor:

Summary

Domain adaptation is critical for success in new, unseen environments. Adversarial adaptation models applied in feature spaces discover domain invariant representations, but are difficult to visualize and sometimes fail to capture pixel-level and low-level domain shifts. Recent work has shown that generative adversarial networks combined with cycle-consistency constraints are surprisingly effective at mapping images between domains, even without the use of aligned image pairs.

Author proposes a novel discriminatively-trained Cycle-Consistent Adversarial Domain Adaptation model. CyCADA adapts representations at both the pixel-level and feature-level, enforces cycle-consistency while leveraging a task loss, and does not require aligned pairs. Our model can be applied in a variety of visual recognition and prediction settings. We show new state-of-the-art results across multiple adaptation tasks, including digit classification and semantic segmentation of road scenes demonstrating transfer from synthetic to real world domains.

2018

Year Released

Key Links & Stats

tkhkaeio / CyCADA

CyCADA: Cycle-Consistent Adversarial Domain Adaptation

CyCADA: Cycle-Consistent Adversarial Domain Adaptation

@misc{https://doi.org/10.48550/arxiv.1711.03213, doi = {10.48550/ARXIV.1711.03213}, url = {https://arxiv.org/abs/1711.03213}, author = {Hoffman, Judy and Tzeng, Eric and Park, Taesung and Zhu, Jun-Yan and Isola, Phillip and Saenko, Kate and Efros, Alexei A. and Darrell, Trevor}, keywords = {Computer Vision and Pattern Recognition (cs.CV), FOS: Computer and information sciences, FOS: Computer and information sciences}, title = {CyCADA: Cycle-Consistent Adversarial Domain Adaptation}, publisher = {arXiv}, year = {2017}, copyright = {arXiv.org perpetual, non-exclusive license} }

ML Tasks

  1. Domain Adaptation
  2. Semantic Segmentation

ML Platform

  1. Pytorch

Modalities

  1. General

Verticals

  1. General

CG Platform

  1. Not Applicable

Related organizations

BAIR, UC Berkeley

OpenAI

CS, Boston University