Transparency and Explainability
The AI/Data Science Professional Lectorial (2022, RMIT University)
|An interactive overview of surrogate explainers for the 2022 RMIT Univeristy AI/Data Science Professional lectorial.|
|Where:||(MS Teams) RMIT University, Melbourne, Victoria, Australia.|
|When:||4.30–6.30pm on Tuesday, March 29th, 2022.|
Table of Contents
About the Lectorial
Surrogate explainability is a popular transparency technique for assessing trustworthiness of predictions output by black-box machine learning models. While such explainers are often presented as monolithic, end-to-end tools, they in fact exhibit high modularity and scope for parameterisation1. This observation suggests that each use case may require a bespoke surrogate built and tuned for the problem at hand. This lectorial overviews the influence of parameterisation and configuration of surrogates on the explanations that they generate for tabular and image data. In particular, it discusses the influence of segmentation granularity and super-pixel occlusion colour for images, as well as discretisation and binarisation of continuous features for tabular data. Understanding these dependencies helps with building robust and trustworthy surrogate explainers, whose insights can be relied upon. This overview is presented as an interactive slideshow, which is complemented by a no-code practical example provided as an iPython widget delivered through a Jupyter Notebook.
FAT Forensics (Software)
To support the goals of this lectorial, we employ
FAT Forensics – an open source Python package
that can inspect selected fairness, accountability and transparency aspects
of data (and their features), models and predictions.
The toolbox spans all of the FAT domains because many of them share underlying
algorithmic components that can be reused in multiple different
implementations, often across the FAT borders.
This interoperability allows, for example, a counterfactual data point
generator to be used as a post-hoc explainer of black-box predictions on
one hand, and as an individual fairness (disparate treatment) inspection tool
on the other.
The modular architecture23 enables
FAT Forensics to deliver robust and tested
low-level FAT building blocks as well as a collection of FAT tools built on top
Users can choose from these ready-made tools or, alternatively, combine the
available building blocks to create their own bespoke algorithms without the
need of modifying the code base.
The presentation is provided as an interactive set of slides utilising iPyWidgets and built with a Jupyter Notebook based on RISE and reveal.js. The demonstration – highlighting the importance of tabular surrogate parameterisation, data sampling and interpretable representation composition (discretisation of numerical features) – is given as an interactive iPyWidgets embedded in a Jupyter Notebook. Either of these notebooks can be executed locally on one’s own machine or launched directly in the web browser through Google Colab or MyBidner.
Kacper is a research fellow with
The ARC Centre of Excellence for Automated Decision-Making and Society (ADM+S)
at the RMIT University.
His main research focus is transparency – interpretability and
explainability – of machine learning systems.
In particular, he has done work on enhancing transparency of logical predictive
models (and their ensembles) with counterfactual explanations.
Kacper is the designer and lead developer of the
FAT Forensics package.
Kacper Sokol, Alexander Hepburn, Raul Santos-Rodriguez, and Peter Flach. 2019. bLIMEy: Surrogate Prediction Explanations Beyond LIME. 2019 Workshop on Human-Centric Machine Learning (HCML 2019) at the 33rd Conference on NeuralInformation Processing Systems (NeurIPS 2019), Vancouver, Canada (2019). https://arxiv.org/abs/1910.13016 ↩
Kacper Sokol, Alexander Hepburn, Rafael Poyiadzi, Matthew Clifford, Raul Santos-Rodriguez, and Peter Flach. 2020. FAT Forensics: A Python Toolbox for Implementing and Deploying Fairness, Accountability and Transparency Algorithms in Predictive Systems. Journal of Open Source Software, 5(49), p.1904. https://joss.theoj.org/papers/10.21105/joss.01904 ↩
Kacper Sokol, Raul Santos-Rodriguez, and Peter Flach. 2019. FAT Forensics: A Python Toolbox for Algorithmic Fairness, Accountability and Transparency. arXiv preprint arXiv:1909.05167. https://arxiv.org/abs/1909.05167 ↩