Complete Tests:
Test Results by Site:
Online Poker Watchdog has carried out 'bad beat' tests on Merge Network hands. The Merge Network is one of the major online poker networks - it has 69 member sites that share the network. Sites on the Merge Network include: Carbon Poker, Lock Poker & RPM Poker.
We started by downloading a sample of over 1 million Merge Network hands from PTR* and importing them to Poker Tracker*.
1) We separated those hands that were all-in pre-flop and looked at these hands from the perspective of the 'underdog' in every case ('all-in equity'<50%).
2) We calculated the difference between the number of hands that were expected to win in an ideal world, with the number of hands that actually won in reality - this is called the actual deviation.
If the actual deviation is positive it means that generally the underdog hands improved to win more often than expected - i.e. there were more bad beats than expected.
If the deal at the Merge Network was fair the actual deviation should be very small.
3) But how small is very small? To answer this question we calculated the standard deviation of the sample so that we could compare the actual deviation to it.
If the actual deviation is less than 2 times the standard deviation then this is strong evidence of no bias in the sample.
If the actual deviation is greater than 5 times the standard deviation then this is strong evidence of a bias in the sample.
Sometimes results will occur where the actual deviation is slightly greater than 2 times the standard deviation (and occasionally greater than 3 standard deviations). This can occur from time to time due to variance. It does not necessarily mean that a bias has been found, although it may be grounds to run further tests on a particular poker site.
This bad beat test has been repeated for pre-flop dominated hands ('all-in equity' from 17% to 32%) and for hands that were all-in on the flop:
Data Group | Actual Deviation | Standard Deviation | Actual Deviation/Standard Deviation |
---|---|---|---|
Pre-flop: underdog | -13.6 | 28.2 | -0.48 |
Pre-flop: dominated | -2.9 | 17.8 | -0.16 |
Flop: underdog | -5.3 | 24.4 | -0.22 |
Turn: underdog | +23.0 | 18.8 | +1.23 |
From the table above we can see that the actual deviation is well within two standard deviations in all tests and we can conclude that there is no evidence of rigging.
For more information on interpreting deviation see this article.