View publication

The abundance of wrist-worn heart rate measuring devices enables long term cardiovascular monitoring through photoplethysmography (PPG). Such signals contain unique identifiable information that can help in biometric authentication. In this work, we propose Fusion-ID, which use wrist-worn PPG sensors fused with motion sensor data as a way to do bio authentication on wrist worn devices. We conducted a user study using a PPG and motion sensor enabled wrist-worn device and collected data from 247 users. We then propose a novel sensor fusion deep Siamese network architecture for feature embedding. Specifically, Fusion-ID fuses information from multiple channels of PPG readings with information from motion sensors to authenticate a user. Our architecture only needs a few seconds of sample data (shots) from new users, and it is the first PPG-based bio-authentication method that is capable of adapting to new users without requiring on-device training or fine-tuning of the model. Our evaluations confirm the effectiveness of proposed siamese network with sensor fusion with an average accuracy of 95% and 12% false rejection rate at the 1% false acceptance rate operating point.

Related readings and updates.

Naturalistic Head Motion Generation From Speech

Synthesizing natural head motion to accompany speech for an embodied conversational agent is necessary for providing a rich interactive experience. Most prior works assess the quality of generated head motion by comparing them against a single ground-truth using an objective metric. Yet there are many plausible head motion sequences to accompany a speech utterance. In this work, we study the variation in the perceptual quality of head motions…
See paper details


Apple sponsored Acoustics, Speech, and Signal Processing (ICASSP), which was held in a hybrid format. The virtual event took place on May 7 to 13, and the hybrid main conference on May 22 to 27. ICASSP is the IEEE Signal Processing Society’s flagship conference on signal processing and its applications.

See event details