| Presentation | 2023-02-21 Automatic generation of eating order reports from first-person eating videos Kenshiro Sato, Yoko Yamakata, Kiyoharu Aizawa, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | By automatically generating meal reports used by dietitians for dietary guidance from video footage of meals recorded by wearable cameras, it is possible to provide guidance on the speed and order of eating, which has been difficult in the past. For this purpose, the objective of this research is to detect the meal area from the first-person video taken from the beginning to the end of the meal, track the same dishes, and detect the "timing of being eaten" at each meal. To achieve the above, we first detect the meal region by Yolov7 based on our constructed dataset. Next, we use feature clustering based on the k-means method to classify each meal item that appears in the same video. Finally, we learn a model that predicts the before/after the timing of the same meal item between two frames, and apply it to predict "when the meal was eaten." |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | dietary record video dataset / first-person video / eating behavior / food region tracking |
| Paper # | ITS2022-50,IE2022-67 |
| Date of Issue | 2023-02-14 (ITS, IE) |
| Conference Information | |
| Committee | IE / ITS / ITE-MMS / ITE-ME / ITE-AIT |
|---|---|
| Conference Date | 2023/2/21(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Hokkaido Univ. |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Image Processing, etc. |
| Chair | Kazuya Kodama(NII) / Masahiro Fujii(Utsunomiya Univ.) / Kenji Machida(NHK) / Hiroyuki Arai(Nippon Inst. of Tech.) / Hisaki Nate(Tokyo Polytechnic Univ.) |
| Vice Chair | Hiroyuki Bandoh(NTT) / Toshihiko Yamazaki(Univ. of Tokyo) / Kohei Ohno(Meiji Univ.) / Naohisa Hashimoto(AIST) / / Shogo Muramatsu(Niigata Univ) |
| Secretary | Hiroyuki Bandoh(KDDI Research) / Toshihiko Yamazaki(Nagoya Inst. of Tech.) / Kohei Ohno(Toyama Prefectural Univ.) / Naohisa Hashimoto(NIT, Tsuruoka College) / (Fukuoka Univ.) / Shogo Muramatsu(NHK) / (Hokkaido Univ.) |
| Assistant | Shunsuke Iwamura(NHK) / Shinobu Kudo(NTT) / Taishi Swabe(NAIST) / Keiji Jimi(Gunma Univ.) |
| Paper Information | |
| Registration To | Technical Committee on Image Engineering / Technical Committee on Intelligent Transport Systems Technology / Technical Group on Multi-media Storage / Technical Group on Media Engineering / Technical Group on Artistic Image Technology |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Automatic generation of eating order reports from first-person eating videos |
| Sub Title (in English) | |
| Keyword(1) | dietary record video dataset |
| Keyword(2) | first-person video |
| Keyword(3) | eating behavior |
| Keyword(4) | food region tracking |
| 1st Author's Name | Kenshiro Sato |
| 1st Author's Affiliation | The University(UTokyo) |
| 2nd Author's Name | Yoko Yamakata |
| 2nd Author's Affiliation | The University(UTokyo) |
| 3rd Author's Name | Kiyoharu Aizawa |
| 3rd Author's Affiliation | The University(UTokyo) |
| Date | 2023-02-21 |
| Paper # | ITS2022-50,IE2022-67 |
| Volume (vol) | vol.122 |
| Number (no) | ITS-384,IE-385 |
| Page | pp.pp.41-46(ITS), pp.41-46(IE), |
| #Pages | 6 |
| Date of Issue | 2023-02-14 (ITS, IE) |