Explainability is only available for Forecasts and Predictors generated from an AutoPredictor (CreateAutoPredictor)
Useful links