Stochastic Simulation for Information Retrieval Evaluation: Effectiveness Scores
Class eff.cont
Class eff.disc
Effectiveness Distributions
Helper functions for continuous effectiveness distributions
Continuous Effectiveness Distributions
Continuous Effectiveness as Beta Distribution.
Continuous Effectiveness as Beta Kernel-smoothed Distribution.
Continuous Effectiveness as Truncated Gaussian Kernel-smoothed Distrib...
Continuous Effectiveness as Truncated Normal Distribution.
Fit Vine copula models to matrices of effectiveness scores
Helper functions for discrete effectiveness distributions
Discrete Effectiveness Distributions
Discrete Effectiveness as Beta-Binomial Distribution.
Discrete Effectiveness as Discrete Kernel-smoothed Distribution.
Fit Effectiveness Distributions
Automatic Fitting and Selection of Effectiveness Distributions
Model Selection for Effectiveness Distributions
Transform effectiveness distributions towards a expected value
Plotting tools for Continuous effectiveness distributions
Plotting tools for Discrete effectiveness distributions
Plotting tools for effectiveness distributions
simIReff: Stochastic Simulation for Information Retrieval Evaluation...
Provides tools for the stochastic simulation of effectiveness scores to mitigate data-related limitations of Information Retrieval evaluation research, as described in Urbano and Nagler (2018) <doi:10.1145/3209978.3210043>. These tools include: fitting, selection and plotting distributions to model system effectiveness, transformation towards a prespecified expected value, proxy to fitting of copula models based on these distributions, and simulation of new evaluation data from these distributions and copula models.
Useful links