A System for Efficient DNN Interpretation

About DeepEverest

DNN interpretation is important for researchers and data scientists. While many approaches are being developed, they often do not scale with the size of the datasets and models. The problem that we address in this paper is the efficient execution of a common class of DNN interpretation queries.

We design, implement, and evaluate DeepEverest, a system for the efficient execution of interpretation by example queries over the activation values of a deep neural network. DeepEverest consists of an efficient indexing technique and a query execution algorithm with various optimizations. Experiments with our prototype implementation show that DeepEverest, using less than 20% of the storage of full materialization, significantly accelerates individual queries by up to 63x and consistently outperforms other methods on multi-query workloads that simulate DNN interpretation processes.

DeepEverest focuses on accelerating two representative interpretation by example queries: "find the top-k inputs that produce the highest activation values for an individual neuron or a group of neurons", and "for any input, find the k-nearest neighbors in the dataset using the activation values of a group of neurons based on the proximity in the latent space defined by the group of neurons". These queries help with understanding the functionality of neurons and neuron groups by tying that functionality to the input examples in the dataset.

DeepEverest: Accelerating Declarative Top-K Queries for Deep Neural Network Interpretation. Dong He, Maureen Daum, Walter Cai, Magdalena Balazinska. PVLDB, 15(1): 98 - 111, 2021. doi:10.14778/3485450.3485460 Paper Paper (PVLDB source) DOI Extended Technical Report Code

  author    = {Dong He and
               Maureen Daum and
               Walter Cai and
               Magdalena Balazinska},
  title     = {DeepEverest: Accelerating Declarative Top-K Queries for Deep Neural
               Network Interpretation},
  journal   = {Proc. {VLDB} Endow.},
  volume    = {15},
  number    = {1},
  pages     = {98--111},
  year      = {2021},
  url       = {http://www.vldb.org/pvldb/vol15/p98-he.pdf},
  biburl    = {https://dblp.org/rec/journals/pvldb/HeDCB21.bib}



Please contact Dong He.


This work was supported in part by NSF grants OAC-1739419 and OAC-1934292.