Bayesian Analysis to Compare Models using Resampling Statistics
Visualize the Posterior Distributions of Model Statistics
Visualize the Posterior Distributions of Model Differences
Estimate the Difference Between Models
Bayesian Analysis of Resampling Statistics
Objects exported from other packages
Summarize the Posterior Distributions of Model Statistics
Summarize Posterior Distributions of Model Differences
Extract Posterior Distributions for Models
tidyposterior: Bayesian Analysis to Compare Models using Resampling St...
Simple Transformation Functions
Extra methods for the posterior class to work with dplyr verbs
Extra methods for the posterior_diff class to work with dplyr verbs
Bayesian analysis used here to answer the question: "when looking at resampling results, are the differences between models 'real'?" To answer this, a model can be created were the performance statistic is the resampling statistics (e.g. accuracy or RMSE). These values are explained by the model types. In doing this, we can get parameter estimates for each model's affect on performance and make statistical (and practical) comparisons between models. The methods included here are similar to Benavoli et al (2017) <https://jmlr.org/papers/v18/16-305.html>.
Useful links