Leaderboards

OpenXAI provides leaderboards for systematic evaluation and comparison of various explanation methods. Below, you can see one leaderboard per dataset and model.

Step-by-Step instructions

To participate in the OpenXAI leaderboard, please follow these step-by-step instructions:

  • Use the OpenXAI benchmark dataloader to retrieve a given dataset.
  • Use the OpenXAI LoadModel to load a pre-trained model.
  • Use the OpenXAI Explainer to load a post hoc explanation method.
  • Quantify the performance of the explanation method using OpenXAI evaluation metrics.
  • Submit your scores using this FORM.

We invite submissions to any one or multiple benchmarks in OpenXAI. To be included in the leaderboard, please fill out this FORM, include results of your explanation method and provide the full implementation of your algorithm with proper documentations and GitHub link.

Explore Leaderboards

Faithfulness

Stability

Fairness

Faithfulness

Stability

Fairness

Faithfulness

Stability

Fairness

Fairness evaluation is not applicable for the HELOC dataset as it does not include any protected attributes.

Faithfulness

Stability

Fairness

Fairness evaluation is not applicable for the HELOC dataset as it does not include any protected attributes.

Faithfulness

Stability

Fairness

Faithfulness

Stability

Fairness

Faithfulness

Stability

Fairness

Fairness evaluation is not applicable for the Synthetic dataset as it does not include any protected attributes.

Faithfulness

Stability

Fairness

Fairness evaluation is not applicable for the Synthetic dataset as it does not include any protected attributes.

Faithfulness

Stability

Fairness

Faithfulness

Stability

Fairness

Faithfulness

Stability

Fairness

Fairness evaluation is not applicable for the Give me some credit dataset as it does not include any protected attributes.

Faithfulness

Stability

Fairness

Fairness evaluation is not applicable for the Give me some credit dataset as it does not include any protected attributes.