Adam Sampson's significance bookmarkshttps://bookmarks.offog.org/ats/significanceAdam Sampson2014-08-24T22:44:07ZHow Not To Run An A/B Testhttps://bookmarks.offog.org/edit?url=http%3A%2F%2Fwww.evanmiller.org%2Fhow-not-to-run-an-ab-test.html2014-08-24T22:44:07Z"Decide on a sample size in advance and wait until the experiment is over before you start believing the “chance of beating original” figures that the A/B testing software gives you."The Earth is Round (p < 0.5)https://bookmarks.offog.org/edit?url=http%3A%2F%2Fist-socrates.berkeley.edu%2F%7Emaccoun%2FPP279_Cohen1.pdf2014-03-26T17:20:34ZAn extremely grumpy study of statistical significance. This is worth reading in conjunction with Susan's stats tutorial, since it gives more examples of what significance actually means (and why it's probably not what you think it means).Computing and Interpreting Effect Sizes - Springerhttps://bookmarks.offog.org/edit?url=http%3A%2F%2Flink.springer.com%2Fchapter%2F10.1007%252F1-4020-2456-8_52014-03-26T17:19:30ZA fairly grumpy study of effect size measurement -- this makes some good points, though.FAQ: Why is the Mann-Whitney significant when the medians are equal?https://bookmarks.offog.org/edit?url=http%3A%2F%2Fwww.ats.ucla.edu%2Fstat%2Fmult_pkg%2Ffaq%2Fgeneral%2Fmann-whitney.htm2014-03-26T17:17:18ZA nice example of why the rank-sum test *doesn't* test whether the medians are the same. (Unless the distributions are otherwise very similar.)Statistics with Confidencehttps://bookmarks.offog.org/edit?url=http%3A%2F%2Fwww.cs.york.ac.uk%2Fnature%2Ftangent%2Fstats.pdf2014-03-19T10:56:42ZSusan's stats tutorial (which I first saw at ICARIS 2009). Highly recommended for students who're doing performance measurement.