So You Think You Can Test?

Decision making under uncertainty is complicated business. This game aims to make decision makers more aware of the complex trade off between indecision and acting on insufficient information.

You will be presented with a series of ten independently simulated experiments. Only one of these is simulating a scenario where there is a difference in effect between base and variant. The other nine are so-called A/A experiments, with absolutely no difference between the two treatment groups.

Because of random fluctuations, combined with the fact that we observe the experiments as they are simulated, all ten result will seem to change over time. Your job as a decision maker is to identify which of these ten experiments is not an A/A.

Once you are certain you've identified the right experiment, make your choice known by clicking (or by using the numeric keys "0" through "9"). With every subsequent level, the size of the simulated effect will diminish, making your task progressively more difficult. A point is awarded for correct decisions; mistakes will cost a point. When visitors reaches zero, the game is over.

This is a game of chance, but not of chance alone. Good luck!

Click To Start

Created by Lukas Vermeer — Make this more awesome on GitHub

Game Over!

The game is over. Time to evaluate how well you've performed.

Click To Start Again

Created by Lukas Vermeer — Make this more awesome on GitHub
Effect Score Visitors