| Presentation | 2018-02-27 Coverage Expansion in mmWave V2I Communications by Deep Reinforcement Learning Based Vehicle Re-deployment Akihito Taya, Takayuki Nishio, Masahiro Morikura, Koji Yamamoto, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | The small coverage of road side units (RSUs) is one of the challenges in millimeter wave (mmWave) communications for autonomous vehicles. A key concept of this paper is leveraging vehicles’ position controllability to increase the coverages of RSUs by creating long multi-hop relays. Vehicles should be positioned where they can communicate with each other in line-of-sight (LOS) paths because the blockages of LOS paths is a crucial problem in mmWave communications. In this paper, a vehicle position control method based on reinforcement learning (RL) is proposed to avoid blockage and create long relays in order to increase coverage. RL enables vehicles to predict the future coverages achieved by their subsequent actions and therefore, its performance exceeds that of a conventional strategy which is used for moving control of wireless sensor networks. This paper also proposes state designs with information of relay length to improve the performance of increasing coverages. Simulation results confirm that the proposed method increase coverages even when not all the vehicles’ positions are controllable. In addition, it is shown that a RL-based strategy achieves higher performances than gradient-based strategies. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Vehicular Communications / MmWave Communications / Multihop / Deep Reinforcement Learning |
| Paper # | MoNA2017-69 |
| Date of Issue | 2018-02-19 (MoNA) |
| Conference Information | |
| Committee | MoNA / ASN / IPSJ-MBL / IPSJ-UBI |
|---|---|
| Conference Date | 2018/2/26(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Sophia University |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Ubiquitous system, Ambient intelligence, Next generation wireless communicasion, Mobile network, etc. |
| Chair | Ryoichi Shinkuma(Kyoto Univ.) / Hiraku Okada(Nagoya Univ.) / 河口 信夫(名大) / 寺田 努(神戸大) |
| Vice Chair | Shigeaki Tagashira(Kansai Univ.) / Gen Kitagata(Tohoku Univ.) / Shigeki Shiokawa(KAIT) / Jin Nakazawa(Keio Univ.) / Satoru Yamano(NEC) / 深澤 佑介(ドコモ) / 久保 健(KDDI) / 北村 操代(三菱電気) |
| Secretary | Shigeaki Tagashira(Kyushu Univ.) / Gen Kitagata(NTT) / Shigeki Shiokawa(NEC) / Jin Nakazawa(NICT) / Satoru Yamano(Sophia Univ.) / 深澤 佑介(愛知工大) / 久保 健(阪大) / 北村 操代(豊橋技科大) / (NTT) |
| Assistant | Takayuki Nishio(Kyoto Univ.) / Takato Saito(NTT) / Hiroto Aida(Doshisha Univ.) / Tomoyuki Ota(Hiroshima City Univ.) / Tatsuya Kikuzuki(Fujitu Lab.) / Ryo Nakano(HITACHI) / Yoshifumi Hotta(Mitsubishi Electric) |
| Paper Information | |
| Registration To | Technical Committee on Mobile Network and Applications / Technical Committee on Ambient intelligence and Sensor Networks / Special Interest Group on Mobile Computing and Pervasive Systems / Special Interest Group on Ubiquitous Computing System |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Coverage Expansion in mmWave V2I Communications by Deep Reinforcement Learning Based Vehicle Re-deployment |
| Sub Title (in English) | |
| Keyword(1) | Vehicular Communications |
| Keyword(2) | MmWave Communications |
| Keyword(3) | Multihop |
| Keyword(4) | Deep Reinforcement Learning |
| 1st Author's Name | Akihito Taya |
| 1st Author's Affiliation | Kyoto University(Kyoto Univ.) |
| 2nd Author's Name | Takayuki Nishio |
| 2nd Author's Affiliation | Kyoto University(Kyoto Univ.) |
| 3rd Author's Name | Masahiro Morikura |
| 3rd Author's Affiliation | Kyoto University(Kyoto Univ.) |
| 4th Author's Name | Koji Yamamoto |
| 4th Author's Affiliation | Kyoto University(Kyoto Univ.) |
| Date | 2018-02-27 |
| Paper # | MoNA2017-69 |
| Volume (vol) | vol.117 |
| Number (no) | MoNA-450 |
| Page | pp.pp.317-322(MoNA), |
| #Pages | 6 |
| Date of Issue | 2018-02-19 (MoNA) |