A Dataset of Thermal images of User Interfaces

Khamis, M. , Bekaert, P., Marky, K. and Islam, M. S. (2022) A Dataset of Thermal images of User Interfaces. [Data Collection]

Datacite DOI: 10.5281/zenodo.5997104

Collection description

Recent advancement in sensor technology facilitates having a thermal camera at a lower price. These cameras have many potential applications but can also be used for malicious purposes, such as capturing user interfaces and retrieving user information from heat traces in the thermal images. This dataset is created during an interactive study investigating the threat of thermal attacks on user interfaces. We adapted the following experimental setup during data collection.

2 camera perspectives- FLIR E8-XT camera placed behind the participant and Optris PI 450i camera placed left of the participant.
4 types of input devices- i) smartphone, ii) 3 keyboards- a PBT keyboard, an ABS keyboard, and a metal frame keyboard
3 types of user input data (text, email address, password)
In summary, we have collected 1152 images from the FLIR camera and another 1152 images from the Optris camera through an interactive study with 32 participants. For each participant, we captured 36 images (9 types of user input, 4 types of input devices). The created dataset can be used to evaluate the deep learning model developed to prevent thermal imaging attacks. Furthermore, the ground truth user input of text, email address, and passwords are structured along with the corresponding image ID so that the advanced data-driven model can be employed to identify user input and investigate the type of user input that can be easily cracked using machine learning techniques.

Funding:
Keywords: Thermal image, User interface, Thermal attacks
College / School: College of Science and Engineering > School of Computing Science
Date Deposited: 14 Aug 2024 10:16
URI: https://researchdata.gla.ac.uk/id/eprint/1693

Available Files

There are no files for this dataset available to download.

Repository Staff Only: Update this record

Khamis, M. , Bekaert, P., Marky, K. and Islam, M. S. (2022); A Dataset of Thermal images of User Interfaces

Zenodo

DOI: 10.5281/zenodo.5997104

Retrieved: 2024-12-08