How Not To Run An A/B Test edit / delete

"Decide on a sample size in advance and wait until the experiment is over before you start believing the “chance of beating original” figures that the A/B testing software gives you."

to ag0803 honours significance statistics testing ... on 24 August 2014

The Earth is Round (p < 0.5) edit / delete

An extremely grumpy study of statistical significance. This is worth reading in conjunction with Susan's stats tutorial, since it gives more examples of what significance actually means (and why it's probably not what you think it means).

to ag0803 significance statistics ... on 26 March 2014

Computing and Interpreting Effect Sizes - Springer edit / delete

A fairly grumpy study of effect size measurement -- this makes some good points, though.

to effect-size significance statistics ... on 26 March 2014

FAQ: Why is the Mann-Whitney significant when the medians are equal? edit / delete

A nice example of why the rank-sum test *doesn't* test whether the medians are the same. (Unless the distributions are otherwise very similar.)

to median non-parametric significance statistics ... on 26 March 2014

Statistics with Confidence edit / delete

Susan's stats tutorial (which I first saw at ICARIS 2009). Highly recommended for students who're doing performance measurement.

to ag0803 benchmarking honours performance science significance statistics ... on 19 March 2014

Browser bookmarks: tasty+ | tasty= Log in | Export | Atom