This is the first release of the Lightning-UQ-Box.
The following table shows the current status of implemented methods.
Single Forward Pass Methods
| Uncertainty Quantification Method (UQ-Method) | Regression | Classification | Segmentation | Pixel Wise Regression |
|-----------------------------------------------|:----------:|:--------------:|:------------:|:---------------------:|
| Quantile Regression (QR) | ✅ | ❌ | ❌ | ⏳ |
| Deep Evidential (DE) | ✅ | ⏳ | ⏳ | ⏳ |
| Mean Variance Estimation (MVE) | ✅ | ❌ | ❌ | ⏳ |
Approximate Bayesian Methods
| Uncertainty Quantification Method (UQ-Method) | Regression | Classification | Segmentation | Pixel Wise Regression |
|-----------------------------------------------|:----------:|:--------------:|:------------:|:---------------------:|
| Bayesian Neural Network VI ELBO (BNN_VI_ELBO) | ✅ | ✅ | ✅ | ⏳ |
| Bayesian Neural Network VI (BNN_VI) | ✅ | ⏳ | ⏳ | ⏳ |
| Deep Kernel Learning (DKL) | ✅ | ✅ | ❌ | ❌ |
| Deterministic Uncertainty Estimation (DUE) | ✅ | ✅ | ❌ | ❌ |
| Laplace Approximation (Laplace) | ✅ | ✅ | ❌ | ❌ |
| Monte Carlo Dropout (MC-Dropout) | ✅ | ✅ | ✅ | ⏳ |
| Stochastic Gradient Langevin Dynamics (SGLD) | ✅ | ✅ | ⏳ | ⏳ |
| Spectral Normalized Gaussian Process (SNGP) | ✅ | ✅ | ❌ | ❌ |
| Stochastic Weight Averaging Gaussian (SWAG) | ✅ | ✅ | ✅ | ⏳ |
| Deep Ensemble | ✅ | ✅ | ✅ | ⏳ |
Generative Models
| Uncertainty Quantification Method (UQ-Method) | Regression | Classification | Segmentation | Pixel Wise Regression |
|-----------------------------------------------|:----------:|:--------------:|:------------:|:---------------------:|
| Classification And Regression Diffusion (CARD)| ✅ | ✅ | ❌ | ❌ |
| Probabilistic UNet | ❌ | ❌ | ✅ | ❌ |
| Hierarchical Probabilistic UNet | ❌ | ❌ | ✅ | ❌ |
Post-Hoc methods
| Uncertainty Quantification Method (UQ-Method) | Regression | Classification | Segmentation | Pixel Wise Regression |
|-----------------------------------------------|:----------:|:--------------:|:------------:|:---------------------:|
| Test Time Augmentation (TTA) | ✅ | ✅ | ⏳ | ⏳ |
| Temperature Scaling | ❌ | ✅ | ⏳ | ❌ |
| Conformal Quantile Regression (Conformal QR) | ✅ | ❌ | ❌ | ⏳ |
| Regularized Adaptive Prediction Sets (RAPS) | ❌ | ✅ | ❌ | ❌ |
Contributors
nilsleh
adamjstewart
stde
orbitfold
nm19000
JakobCode