Estimation of joint Shannon entropy for a set of categorical variables.
Estimation of joint Shannon entropy for a set of categorical variables.
The multivariate joint Shannon entropy provides an estimation of the measure of the uncertainty associated with a set of variables (see https://en.wikipedia.org/wiki/Joint_entropy).