To screen, or not to screen: An experimental comparison of two methods for correlating video game loot box expenditure and problem gambling severity

Loot boxes are gambling-like products found in video games that players can buy with real-world money to obtain random rewards. A positive correlation between loot box spending and problem gambling severity has been well-replicated. Some researchers recently argued that this observed positive correlation may be due to participants incorrectly interpreting problem gambling questions as applying to their loot box expenditure because they see loot box purchasing as a form of ‘gambling.’ We experimentally tested this alternative explanation for the observed positive correlation (N = 2,027), by manipulating whether all participants were given the problem gambling scale as the previous literature generally had (the ‘non-screening’ approach; n = 1,005), or by ‘screening’ participants (n = 1,022) by only giving the problem gambling scale to those reporting recent gambling expenditure. Through the latter screening process, we clarified and calibrated what ‘gambling’ means by providing an exhaustive list of activities that should be accounted for and specifically instructed participants that loot box purchasing is not to be considered a form of ‘gambling.’ Results showed positive correlations between loot box spending and problem gambling across both experimental conditions. In addition, a predicted positive correlation emerged between binary past-year gambling participation and loot box expenditure in the screening group. These experimental results confirm that the association between loot box spending and problem gambling severity is likely not due to participants misinterpreting problem gambling questions as being relevant to their loot box spending. However, problem gambling severity was inflated in the non-screening group, meaning that future research on gambling-like products should include gambling participation screening questions; better define what ‘gambling’ means; potentially exclude non-gamblers from analysis; and, importantly, provide explicit instructions on whether certain activities should not be considered a form of ‘gambling.’