Presentation 2021-03-14
VLS-BERT: Meaning Acquisition of Sentence-Final Particles from Vision, Language and Subjective Feelings
Akane Matsushima, Natsuki Oka, Chie Fukada, Yuko Yoshimura, Koji Kawahara,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Understanding utterance meanings at the illocutionary force level (Austin 1962), such as question, request, greeting, is the first step in sharing intentions, and function words help us identify them. We aim to constructively grasp the acquisition mechanism of function words, especially sentence-final particles in Japanese, by constructing a model that integrates both automatic and conscious processings. In this study, we propose a model that associates vision, language, and subjective feelings by self-attention (VLS-BERT), which is a part of the developmental model of children’s automatic processing at thestage of acquiring sentence-final particles. Our simulation results showed that the model could associate linguistic information with visual information and/or subjective feelings. Furthermore, the result proved that the linguistic information of each of the utterances with the sentence-final particle yo was more strongly associated with the visual information and/or subjective feelings immediately after the time of the utterance, and that the linguistic information of each of the utterances with the sentence-final particle ne was more strongly associated with the visual information and/or subjective feelings at the time of the utterance. To give a specific example, Ringo da yo ‘I want to inform you that here is an apple’ was associated with the visual information at the next time of the utterance (i.e. the information obtained from looking at the apple, and Ringo da ne ‘I want to share the feeling that we are both looking at the apple’ was associated with the visual information at the time of the utterance. This result indicates that VLS-BERT implicitly acquired the meanings of the two different sentence-final particles.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) language acquisition / BERT / self-attention / sentence-final particles
Paper # TL2020-20
Date of Issue 2021-03-07 (TL)

Conference Information
Committee TL
Conference Date 2021/3/14(1days)
Place (in Japanese) (See Japanese page)
Place (in English) Online
Topics (in Japanese) (See Japanese page)
Topics (in English) Theme 1 : Language and Learning, Learning Language, Theme 2: Abduction of meaning, "Ba" in Co-Creation, Abduction and Innovation, Theme 3: Language Environments and Language Resources
Chair Yasushi Tsubota(Kyoto Inst. of Tech.)
Vice Chair Tadahisa Kondo(Kogakuin Univ.) / Kazuhiro Takeuchi(Osaka Electro-Comm. Univ.)
Secretary Tadahisa Kondo(Kobe Gakuin Univ.) / Kazuhiro Takeuchi(Ferris Univ.)
Assistant Nobuyuki Jincho(Miidas) / Akio Shimogori(Hakodate-ct)

Paper Information
Registration To Technical Committee on Thought and Language
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) VLS-BERT: Meaning Acquisition of Sentence-Final Particles from Vision, Language and Subjective Feelings
Sub Title (in English)
Keyword(1) language acquisition
Keyword(2) BERT
Keyword(3) self-attention
Keyword(4) sentence-final particles
1st Author's Name Akane Matsushima
1st Author's Affiliation Kyoto Institute of Technology(KIT)
2nd Author's Name Natsuki Oka
2nd Author's Affiliation Kyoto Institute of Technology(KIT)
3rd Author's Name Chie Fukada
3rd Author's Affiliation Kyoto Institute of Technology(KIT)
4th Author's Name Yuko Yoshimura
4th Author's Affiliation Kanazawa University(Kanazawa Univ.)
5th Author's Name Koji Kawahara
5th Author's Affiliation Nagoya University of Foreign Studies(NUFS)
Date 2021-03-14
Paper # TL2020-20
Volume (vol) vol.120
Number (no) TL-427
Page pp.pp.12-17(TL),
#Pages 6
Date of Issue 2021-03-07 (TL)