Adam Sampson's non-parametric bookmarkshttps://bookmarks.offog.org/ats/non-parametricAdam Sampson2014-03-26T17:29:50ZPublication: Quantifying Performance Changes with Effect Size Confidence Intervals - School of Computing - University of Kenthttps://bookmarks.offog.org/edit?url=http%3A%2F%2Fwww.cs.kent.ac.uk%2Fpubs%2F2012%2F3233%2F2014-03-26T17:29:50ZTech report with more details of the statistics behind Tomas/Richard's approach. In particular, this describes how to do the same thing in either parametric or non-parametric ways, and gives some description of how badly the parametric approach performs when the underlying data isn't normally distributed (not very badly, as it turns out).FAQ: Why is the Mann-Whitney significant when the medians are equal?https://bookmarks.offog.org/edit?url=http%3A%2F%2Fwww.ats.ucla.edu%2Fstat%2Fmult_pkg%2Ffaq%2Fgeneral%2Fmann-whitney.htm2014-03-26T17:17:18ZA nice example of why the rank-sum test *doesn't* test whether the medians are the same. (Unless the distributions are otherwise very similar.)