Related Experiment Video
Updated: Jan 20, 2026

Nest Building Behavior as an Early Indicator of Behavioral Deficits in Mice
Published on: October 19, 2019
Privacy-Preserving Verification of ML Preprocessing via Model Behavior Indicators
Wenbiao Li1, Anisa Halimi2, Jaideep Vaidya3
1Case Western Reserve University, Cleveland, OH 44106 USA.
Abstract:
We present a privacy-preserving framework to verify whether a declared data preprocessing pipeline was correctly applied before training a machine learning model on sensitive data. The verifier has only black-box query access to the model and combines three behavior indicators: shift in prediction accuracy, Kullback-Leibler (KL) divergence between output distributions, and explanation vectors from Local Interpretable Model-agnostic Explanations (LIME) and SHapley Additive exPlanations (SHAP). The method requires neither the original training records nor ground-truth labels. It supports two tasks: (i) a binary decision on correctness and (ii) a multi-class diagnosis identifying which step is missing. Experiments on three tabular datasets (Diabetes, Adult-Income, Student-Record) show that the binary detector maintains over 75% F1 even under strong local differential privacy ( ). Machine-learning classifiers consistently outperform simple threshold rules in the binary setting, while the two approaches perform comparably for multi-class diagnosis. A label-free variant that clusters explanation vectors achieves competitive accuracy, enabling verification when no labeled pipelines are available. These results demonstrate a practical and scalable approach for safeguarding preprocessing integrity in privacy-sensitive machine learning workflows.
Related Concept Videos
06:11Nest Building Behavior as an Early Indicator of Behavioral Deficits in Mice
Self-Evaluation: Self-Enhancement and Self-Verification
Indicators
06:27Simple Surgical Induction of Conductive Hearing Loss with Verification Using Otoscope Visualization and Behavioral Clap Startle Response in Rat
Strategies of Self-Presentation II: Self-Verification
11:05Behavioral Characterization of an Angelman Syndrome Mouse Model
