« earlier | later » Page 1 of 1
Rigorous Benchmarking in Reasonable Time - Kent Academic Repository
Tomas Kalibera and Richard Jones' paper on how to do benchmarking that's actually meaningful -- presenting results as confidence intervals for effect sizes, with techniques to establish i.i.d. results and work out how many repetitions you need to do. Very nice work for a pretty short paper! (I've spent most of today chasing references from this in the interests of understanding the maths behind it...)
to benchmarking compiler confidence effect-size independence java performance reproducibility statistics vm ... on 26 March 2014
« earlier | later » Page 1 of 1
| - independence | |
| 1 | benchmarking |
| 1 | compiler |
| 1 | confidence |
| 1 | effect-size |
| 1 | independence |
| 1 | java |
| 1 | performance |
| 1 | reproducibility |
| 1 | statistics |
| 1 | vm |
tasty by Adam Sampson.