Pushing the Limits of Remote RF Sensing: Reading Lips Under Face Mask

Hameed, H., Usman, M., Tahir, A., Abbas, H. , Imran, M. and Abbasi, Q. (2022) Pushing the Limits of Remote RF Sensing: Reading Lips Under Face Mask. [Data Collection]

Original publication URL: https://doi.org/10.1038/s41467-022-32231-1

Collection description

The dataset is about reading lips in a privacy preserving manner. In particular, radio frequency (RF) sensing was used to capture unique channel variation due to lip movements. USRP x300 was utilised equipped with the VERT2450 omnidirectional antenna and HyperLOG 7040 X used for reception and transmission respectively. Further, the same experiment was repeated with a Xethru UWB radar, where doppler frequency shifts due to lip movements are captured. We consider six classes for lip movements. Five vowels (a, e, i, o, u) and one empty class where lips were not moving. We are able to read lips even under face masks. Three subjects 1 male and 2 females participated in the experiments.

Funding:
College / School: College of Science and Engineering > School of Engineering
Date Deposited: 07 Jun 2022 09:14
URI: https://researchdata.gla.ac.uk/id/eprint/1282

Available Files

Data

Read me

Repository Staff Only: Update this record

Hameed, H., Usman, M., Tahir, A., Abbas, H. , Imran, M. and Abbasi, Q. (2022); Pushing the Limits of Remote RF Sensing: Reading Lips Under Face Mask

University of Glasgow

DOI: 10.5525/gla.researchdata.1282

Retrieved: 2024-12-14

Downloads

Downloads per month over past year