Shrinking embeddings, not accuracy: Performance-preserving reduction of facial embeddings for complex face verification computations

Research output: Chapter in Book/Report/Conference proceedingConference proceedingspeer-review

Abstract

Conventional embeddings employed in facial verification systems typically consist of hundreds of floating-point numbers, a widely accepted design paradigm that primarily stems from the swift computation of vector distance metrics for identification and authentication such as the L2 norm. However, the utility of such high-dimensional embeddings can become a potential concern when they are integrated into complex comparative strategies, for example multi-party computations. In this study, we challenge the presumption that larger embedding sizes are always superior and provide a comprehensive analysis of the effects and implications of substantially reducing the dimensions of these embeddings (by a factor of 29). We demonstrate that this dramatic size reduction incurs only a minimal compromise in the quality-performance trade-off. This discovery could lead to enhancements in computation efficiency without sacrificing system performance, potentially opening avenues for more sophisticated and decentral uses of facial verification technology. To enable other researchers to validate and build upon our findings, the Rust code used in this paper has been made publicly accessible and can be found at https://github.com/mobilesec/reduced-embeddings-analysis-icprs.
Original languageEnglish
Title of host publication2024 14th International Conference on Pattern Recognition Systems (ICPRS)
Place of PublicationLondon, UK
PublisherIEEE
Number of pages7
ISBN (Electronic)9798350375657
DOIs
Publication statusPublished - Jul 2024
Event14th International Conference on Pattern Recognition Systems - London, United Kingdom
Duration: 15 Jul 202418 Jul 2024
https://www.icprs.org/

Conference

Conference14th International Conference on Pattern Recognition Systems
Abbreviated titleICPRS 2024
Country/TerritoryUnited Kingdom
CityLondon
Period15.07.202418.07.2024
Internet address

Fields of science

  • 102 Computer Sciences
  • 102016 IT security
  • 102025 Distributed systems
  • 102019 Machine learning

JKU Focus areas

  • Digital Transformation
  • Sustainable Development: Responsible Technologies and Management

Cite this