Journal of the Japan Society for Precision Engineering
Online ISSN : 1882-675X
Print ISSN : 0912-0289
ISSN-L : 0912-0289
Paper
Property Analysis of Adversarially Robust Representation
Yoshihiro FUKUHARATakahiro ITAZURIHirokatsu KATAOKAShigeo MORISHIMA
Author information
JOURNAL FREE ACCESS

2021 Volume 87 Issue 1 Pages 83-91

Details
Abstract

In this paper, we address the open question: “What do adversarially robust models look at?” Recently, it has been reported in many works that there exists the trade-off between standard accuracy and adversarial robustness. According to prior works, this trade-off is rooted in the fact that adversarially robust and standard accurate models might depend on very different sets of features. However, it has not been well studied what kind of difference actually exists. In this paper, we analyze this difference through various experiments visually and quantitatively. Experimental results show that adversarially robust models look at things at a larger scale than standard models and pay less attention to fine textures. Furthermore, although it has been claimed that adversarially robust features are not compatible with standard accuracy, there is even a positive effect by using them as pre-trained models particularly in low resolution datasets.

Information related to the author
© 2021 The Japan Society for Precision Engineering
Previous article Next article
feedback
Top