Presentation 2023-06-16
Development of an Extra-corporeal circuit Assembly Support System Using Image Recognition
Hisashi Miyazaki, Takayuki Torigoe, Isao Kayano,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) In this research, we developed a system that automatically displays an assembly manual for an artificial heart-lung machine on smart glasses using image recognition technology based on deep learning. Comparative experiments were conducted on the background and equipment used when capturing the teacher data, and considerations were made to improve the accuracy of image recognition. Specifically, the system targets the circulatory circuit of an artificial heart-lung machine and is able to recognize three types of attached equipment (reservoir, artificial lung, and centrifugal pump). Results showed that the model with the highest accuracy was the trained model built using supervised data captured with a smartphone in a practical room environment. In addition, feature point validation using Grad-CAM confirmed that the system accurately captured the characteristics of the three devices. This system has the potential to improve safety and efficiency, as even new medical engineers can perform preoperative preparation of cardiopulmonary devices while checking manuals. Furthermore, the system is expected to be useful in supporting the training of medical engineers, as they can train themselves in difficult training environments by wearing smart glasses.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Medical engineer / Operations support / Artificial heart-lung machine / Image recognition
Paper # MBE2023-9
Date of Issue 2023-06-09 (MBE)

Conference Information
Committee MBE / IEE-MBE
Conference Date 2023/6/16(1days)
Place (in Japanese) (See Japanese page)
Place (in English) Hokkaido University
Topics (in Japanese) (See Japanese page)
Topics (in English) ME, etc.
Chair Hisashi Yoshida(Kinki Univ.)
Vice Chair Akinori Ueno(Tokyo Denki Univ.)
Secretary Akinori Ueno(Tohoku Inst. of Tech.) / (Univ. of Tsukuba)
Assistant Miki Kaneko(Osaka Univ.) / Akihiko Tsukahara(Tokyo Denki Univ.)

Paper Information
Registration To Technical Committee on ME and Bio Cybernetics / The Technical Committee on Medical and Biological Engineering
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Development of an Extra-corporeal circuit Assembly Support System Using Image Recognition
Sub Title (in English)
Keyword(1) Medical engineer
Keyword(2) Operations support
Keyword(3) Artificial heart-lung machine
Keyword(4) Image recognition
1st Author's Name Hisashi Miyazaki
1st Author's Affiliation Nippon Bunri University(Nippon Bunri Univ.)
2nd Author's Name Takayuki Torigoe
2nd Author's Affiliation Kawasaki University of Medical Welfare(Kawasaki Univ. of Medical Welfare)
3rd Author's Name Isao Kayano
3rd Author's Affiliation Kawasaki University of Medical Welfare(Kawasaki Univ. of Medical Welfare)
Date 2023-06-16
Paper # MBE2023-9
Volume (vol) vol.123
Number (no) MBE-82
Page pp.pp.3-3(MBE),
#Pages 1
Date of Issue 2023-06-09 (MBE)