At MIRU2022, the joint research with NTT received the MIRU Frontier Award. (Jo Kawashima, Yuto Shibata)

At MIRU2022, one of the largest domestic symposiums on computer vision, the joint research with Professor Mariko Isokawa from the Department of Electronics and Electrical Engineering and NTT MIRU Frontier Award was received. (Jo Kawashima, Yuto Shibata)

Yuto Shibata, a fourth-year undergraduate student in the Aoki Media Sensing Laboratory, gave the following oral presentation and received the MIRU Frontier Award, which is given for pioneering research. This research was conducted jointly with Professor Mariko Isokawa from the Department of Electronics and Electrical Engineering and NTT. The lead author is Jo Kawashima, who worked on this research during his master's program.

OL3A-1 3D Pose Estimation of a Person Using Acoustic Signals

Jo Kawashima, Yuto Shibata (Keio University), Mariko Isokawa, Go Irie, Shogo Kimura (Nippon Telegraph and Telephone Corporation), Yoshimitsu Aoki (Keio University)

Award reason: This research boldly tackled the question, "Is it possible to 'hear' a person's three-dimensional pose?" by estimating a person's 3D pose using acoustic information. The study involved constructing a dataset necessary for basic examination, investigating features for active acoustic sensing, proposing a CNN-based estimation method, and evaluating its performance, thereby discovering the potential and future prospects of this research topic. This pioneering approach was deemed worthy of the Frontier Award.