What’s changed technically to make online multiplayer studies possible?
Online Multiplayer studies have been made possible by 4 aspects of functionality coming together:
Multiplayer Tool: Gorilla offers a user-friendly interface that allows researchers to create online experiments without the need for coding expertise. The multiplayer functionality has been added to the main task builder, such that all the functionality available in the task builder (reactions times, mouse-tracking, drag and drop, drawing etc) are available in multiplayer too! Researchers can build their task just as if it was a solo, single-player task, and then simply specify which elements on each screen should be visible to each player. They can also configure responses and other data to be saved to synchronised, networked variables, making it easy to capture a response from Player A and then show it to Player B in real time. Gorilla handles all of the complex synchronisation and also supports text and video chat, ensuring participants believe they are in a genuinely interactive experiment. The text chat records are also available as part of the experiment data.
Lobby: To facilitate participation in multiplayer tasks, a lobby system is essential. Think of it as the waiting area where participants join before the task begins. If you’ve ever played Among Us, you understand the importance of a lobby! Gorilla incorporates this lobby functionality seamlessly into its experiment tree, ensuring a smooth transition from the recruitment stage to the start of the multiplayer task. You can even design your protocol to have multiple rounds where participants rejoin a lobby to be partnered up in different (random) pairs.
Prolific Liquidity: Prolific has great participant liquidity on their site. By liquidity we mean more active participants than are required for the number of studies recruiting at any one time. And so it’s easy to get enough participants through to your study to fill a multiplayer lobby.
Rate Limiting: Prolific operates an algorithm in the background to ensure that the most active participants don’t get all of the studies and thus preserve participant naivety. However, you can ask for this feature to be switched off to supercharge your recruitment speed and ensure that no participant is waiting in the multiplayer lobby for very long. Simply contact the Prolific support team and request that they turn off the rate limiter for your study before you publish it.
Together, we think these possibilities allow cognitive and social science researchers to answer questions that were previously impractical or too expensive to answer. Thereby enabling the research community to better understand how groups of people make decisions together.
Many of the challenges facing our society come down to how we can inspire and organise ourselves to act together. Researchers will need to embrace innovative tools and approaches to provide answers.