Presentation 2021-03-04
[招待講演]因果メカニズム転移による小標本ドメイン適応
,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) In the machine learning tasks where the training data is scarce, domain adaptation (DA) is a promising methodology that exploits the samples of relevant but different probability distributions (the source domains) in addition to the sample of the distribution for which one wants to eventually make inferences (the target domain). To justify DA methods, some assumption on the relations between the source and the target distributions (the transfer assumption) has to be postulated. Therefore, the central question in considering DA methods is "under what transfer assumptions, is the DA possible?" Most of the existing DA methods assume parametric forms of the distribution shift, that some conditional distributions are identical, or that some discrepancy between the source distribution and the target distribution is small in some measure. However, these assumptions may preclude the possibility of knowledge transfer among intricately shifted distributions or apparently very different distributions. In this presentation, as a candidate transfer assumption that may alleviate such a limitation, I consider a meta-distributional transfer assumption. Concretely, we assume that the source domains and the target domains have a shared structural equation model (a statistical causal model) behind the data distributions, and we propose a DA method called the causal mechanism transfer (CMT) that can be used in this scenario. In CMT, we pose the transfer assumption on the data-generating processes, instead of the data distributions that result from them. As a result, the assumption enables statistically justified DA among apparently very different data distributions. In this presentation, I will mainly introduce our recent research on few-shot domain adapting regression, a DA problem setup where we are given a large number of labeled source domain data and few but labeled target domain data, where we proposed a causal mechanism transfer and showed its validity from both theoretical and experimental perspectives.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Domain Adaptation / Structural Causal Model / Nonlinear Independent Component Analysis
Paper # IBISML2020-59
Date of Issue 2021-02-23 (IBISML)

Conference Information
Committee IBISML
Conference Date 2021/3/2(3days)
Place (in Japanese) (See Japanese page)
Place (in English) Online
Topics (in Japanese) (See Japanese page)
Topics (in English) Organized and general sessions on machine learning
Chair Ichiro Takeuchi(Nagoya Inst. of Tech.)
Vice Chair Masashi Sugiyama(Univ. of Tokyo) / Koji Tsuda(Univ. of Tokyo)
Secretary Masashi Sugiyama(AIST) / Koji Tsuda(NTT)
Assistant Atsuyoshi Nakamura(Hokkaido Univ.) / Shigeyuki Oba(Miidas)

Paper Information
Registration To Technical Committee on Infomation-Based Induction Sciences and Machine Learning
Language JPN-ONLY
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English)
Sub Title (in English)
Keyword(1) Domain Adaptation
Keyword(2) Structural Causal Model
Keyword(3) Nonlinear Independent Component Analysis
1st Author's Name
1st Author's Affiliation ()
Date 2021-03-04
Paper # IBISML2020-59
Volume (vol) vol.120
Number (no) IBISML-395
Page pp.pp.78-78(IBISML),
#Pages 1
Date of Issue 2021-02-23 (IBISML)