IEICE Technical Committee Submission System
Conference Paper's Information
Online Proceedings
[Sign in]
Tech. Rep. Archives
 Go Top Page Go Previous   [Japanese] / [English] 

Paper Abstract and Keywords
Presentation 2018-05-25 09:20
Traffic Control with Deep Reinforcement Learning Using an RGB-D Camera for Millimeter-wave Communications
Tomoya Mikuma, Takayuki Nishio, Masahiro Morikura (Kyoto Univ.), Yusuke Asai, Ryo Miyatake (NTT) MoNA2018-1
Abstract (in Japanese) (See Japanese page) 
(in English) In millimeter-wave (mmWave) communications, throughput is decreased seriously when line-of-sight paths are blocked by human bodies. In order to solve the throughput degradation problem, a proactive traffic control system based on RGB-D camera images has been proposed. The system predicts the human blockages and controls data transmission to each STA in order to increase the system throughput. The previous works employ the heuristic traffic control strategy which requires manual tuning suitable for a specific wireless communication environment. In order to solve the problem, this paper proposes a traffic control system with deep reinforcement learning using depth images obtained from an RGB-D camera and states of traffic buffers in a proxy server. The proposed system explores the optimal traffic control strategy appropriate to a wireless communication environment autonomously through trial and error, and it is expected to obtain a traffic control strategy improving the system throughput. The performance of the proposed traffic control system is evaluated by experiments. The experimental results show that the proposed system increases the system throughput as the learning progresses. In addition, the proposed system achieves higher performance compared with a simple heuristic algorithm.
Keyword (in Japanese) (See Japanese page) 
(in English) mmWave communication / IEEE 802.11ad / human blockage / RGB-D camera / deep reinforcement learning / / /  
Reference Info. IEICE Tech. Rep., vol. 118, no. 56, MoNA2018-1, pp. 159-164, May 2018.
Paper # MoNA2018-1 
Date of Issue 2018-05-18 (MoNA) 
ISSN Online edition: ISSN 2432-6380
Copyright
and
reproduction
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034)
Download PDF MoNA2018-1

Conference Information
Committee MoNA IPSJ-DPS IPSJ-MBL IPSJ-ITS  
Conference Date 2018-05-24 - 2018-05-25 
Place (in Japanese) (See Japanese page) 
Place (in English) Eef Information Plaza 
Topics (in Japanese) (See Japanese page) 
Topics (in English) 5G, Mobile Applications, Ubiquitous Services, Mobile Distributed Cloud, ITS, etc. 
Paper Information
Registration To MoNA 
Conference Code 2018-05-MoNA-DPS-MBL-ITS 
Language Japanese 
Title (in Japanese) (See Japanese page) 
Sub Title (in Japanese) (See Japanese page) 
Title (in English) Traffic Control with Deep Reinforcement Learning Using an RGB-D Camera for Millimeter-wave Communications 
Sub Title (in English)  
Keyword(1) mmWave communication  
Keyword(2) IEEE 802.11ad  
Keyword(3) human blockage  
Keyword(4) RGB-D camera  
Keyword(5) deep reinforcement learning  
Keyword(6)  
Keyword(7)  
Keyword(8)  
1st Author's Name Tomoya Mikuma  
1st Author's Affiliation Kyoto University (Kyoto Univ.)
2nd Author's Name Takayuki Nishio  
2nd Author's Affiliation Kyoto University (Kyoto Univ.)
3rd Author's Name Masahiro Morikura  
3rd Author's Affiliation Kyoto University (Kyoto Univ.)
4th Author's Name Yusuke Asai  
4th Author's Affiliation Nippon Telegraph and Telephone Corporation (NTT)
5th Author's Name Ryo Miyatake  
5th Author's Affiliation Nippon Telegraph and Telephone Corporation (NTT)
6th Author's Name  
6th Author's Affiliation ()
7th Author's Name  
7th Author's Affiliation ()
8th Author's Name  
8th Author's Affiliation ()
9th Author's Name  
9th Author's Affiliation ()
10th Author's Name  
10th Author's Affiliation ()
11th Author's Name  
11th Author's Affiliation ()
12th Author's Name  
12th Author's Affiliation ()
13th Author's Name  
13th Author's Affiliation ()
14th Author's Name  
14th Author's Affiliation ()
15th Author's Name  
15th Author's Affiliation ()
16th Author's Name  
16th Author's Affiliation ()
17th Author's Name  
17th Author's Affiliation ()
18th Author's Name  
18th Author's Affiliation ()
19th Author's Name  
19th Author's Affiliation ()
20th Author's Name  
20th Author's Affiliation ()
Speaker Author-1 
Date Time 2018-05-25 09:20:00 
Presentation Time 20 minutes 
Registration for MoNA 
Paper # MoNA2018-1 
Volume (vol) vol.118 
Number (no) no.56 
Page pp.159-164 
#Pages
Date of Issue 2018-05-18 (MoNA) 


[Return to Top Page]

[Return to IEICE Web Page]


The Institute of Electronics, Information and Communication Engineers (IEICE), Japan