Face-Off: Adversarial Face Obfuscation
Varun Chandrasekarana b, Chuhan Gaoc, Brian Tanga b, Kassem Fawaza b✉, Somesh Jhaa b, Suman Banerjeea b
- aUniversity of Wisconsin–Madison
- bUniversity of Wisconsin-Madison, #TAB#
- cMicrosoft, work done while at University of Wisconsin–Madison
- ✉Corresponding author
Papers open inside SciRah from the original publisher or repository; SciRah never hosts them.
Abstract
Abstract Advances in deep learning have made face recognition technologies pervasive. While useful to social media platforms and users, this technology carries significant privacy threats. Coupled with the abundant information they have about users, service providers can associate users with social interactions, visited places, activities, and preferences–some of which the user may not want to share. Additionally, facial recognition models used by various agencies are trained by data scraped from social media platforms. Existing approaches to mitigate associated privacy risks result in an imbalanced trade-off between privacy and utility. In this paper, we address this trade-off by proposing Face-Off, a privacy-preserving framework that introduces strategic perturbations to images of the user’s face to prevent it from being correctly recognized. To realize Face-Off, we overcome a set of challenges related to the black-box nature of commercial face recognition services, and the scarcity of literature for adversarial attacks on metric networks. We implement and evaluate Face-Off to find that it deceives three commercial face recognition services from Microsoft, Amazon, and Face++. Our user study with 423 participants further shows that the perturbations come at an acceptable cost for the users.
TL;DRThis paper implements and evaluates Face-Off, a privacy-preserving framework that introduces strategic perturbations to images of the user’s face to prevent it from being correctly recognized, and finds that it deceives three commercial face recognition services from Microsoft, Amazon, and Face++. (Semantic Scholar)