David L. Wallace
Comment on Journal of the American Statistical Association
September 1983, volume 78, Number 382
The framework used in this website is presented in the article Carriço et al. (2006) for comparing several typing methods applied to a collection of Streptococcus pyogenes. The article proposes the use of Simpson's Index of Diversity, Adjusted Rand and Wallace coefficients as a quantitative way to evaluate the congruence of results between different typing methods.
This framework was further extended by Pinto et al. (2008) defining Wallace coefficient confidence intervals.
The use of resampling methods for confidence intervals estimation for pairwise agreement measures was evaluated in Severiano et al. (2011). In this study, simulations showed that the jackknife pseudo-values method performs better than the bootstrap at accurately estimating confidence intervals for pairwise agreement measures.
In this tutorial we provide a brief definition of the coefficients proposed and their use. You can also find
here the ECCMID presentation of the first version of this website.