So you want to do ESM? Ten Essential Topics for Implementing the Experience Sampling Method (ESM)

The experience sampling method (ESM) captures psychological experiences over time and in everyday contexts, thereby offering exciting potential for collecting more temporally fine-grained and ecologically valid data for psychological research. Given that rapid methodological developments make it increasingly difficult for novice ESM researchers to be well-informed about standards of ESM research and to identify resources that can serve as useful starting points, this article provides a primer on ten essential design and implementation considerations for ESM studies. Specifically, we i) compare ESM with cross-sectional, panel, and cohort approaches, and discuss considerations regarding: ii) item content and phrasing, iii) choosing and formulating response options, iv) timescale (sampling scheme, sampling frequency, survey length, and study duration), v) change properties and stationarity, vi) power and effect sizes, vii) missingness, attrition, and compliance, viii) data assessment and administration, ix) reliability, as well as x) replicability and generalizability. For all ten topics we discuss challenges and – if available – potential solutions, and provide literature that can serve as starting points for more in-depth readings. We also share access to a living, web-based resources library with a more extensive catalogue of literature, to facilitate further learning about the design and implementation of ESM. Lastly, we list topics that, although beyond the scope of our article, can be relevant for the success of ESM studies. Taken together, our article highlights the most essential design and implementation considerations for ESM studies, aids the identification of relevant in-depth readings, and can thereby support the quality of future ESM studies.