A paper was accepted to ICPR 2026 (M2 Manabe)

Sign-to-Speech — Accepted to ICPR 2026

"Sign-to-Speech Prosody Transfer via Sign Reconstruction-based GAN" has been accepted to ICPR 2026.

This research proposes a new task, "Sign-to-Speech Prosody Transfer," which directly integrates the prosody of sign language (emphasis and intonation) into speech without passing through text. To preserve prosodic information of sign movements lost in the conventional two-step pipeline (sign language → text → speech), we developed S2PFormer utilizing Sign Language Prosody Reconstruction, enabling training on unpaired datasets.

Authors: Toranosuke Manabe, Yuto Shibata, Shinnosuke Takamichi, Yoshimitsu Aoki