Recruitment Policies


Overview


Welcome to the Recruitment Policy Options Tooling Reference Guide.

Here you can learn about the different recruitment policies available in Gorilla by exploring the list of available Recruitment Policies on the left.

Disabled


This recruitment policy is the default starting policy for all tasks. You are able to preview and edit your task but participants are not able to access it via any of the previous methods. Once you have completed your data collection on an experiment, or if you need to halt the experiment for any reason, returning the recruitment policy to 'Disabled' will prevent any further access, regardless of the previous recruitment policy setting.

Pilot


This recruitment policy provides a link where participants have to log in using a name as an ID. This name is not controlled, so they can log in with anything.

We often use this policy for testing by using the names like Test1, Test2, TestN! We also use it for piloting on team members, with us each using our initials.

Similar to the 'Simple link,' the link can be distributed by any means. The additional benefit is the ability to identify participants later on, allow participants to resume where they left off.

Supervised


This recruitment policy allows you to define a set of Public ID's to be used with participants who will log in with you in person. This is useful for a case where participants may not have email addresses and/or the experiment will take place in an area you can control/supervise such as a classroom or lab. Similarly to the email methods and the pilot link, participants would be able to log in and resume their experiment where they left it. If a participant shared their public id with someone else, that person would be able to log in as them. However, unlike the methods where links are sent to the users, they would only be able to access the experiment from your controlled area, limiting the possibility that a user could utilise someone elses id.

Resend Email Action: From your participants screen, for participants you have uploaded emails for, you can select the 'resend email' from the Action-menu. This will send the participant an email reminder to take part in your experiment. You may also wish to use this action to encourage participants to continue with their experiment if they have not yet returned to complete it.

Email Shot


This recruitment policy allows you to define a list of email addresses for participants. Each email address receives a personalized link. This allows you to identify participants and prevent participants from repeating an experiment without the participant needing to log in with an ID, like the Pilot. There is nothing to prevent the participant from sharing their unique URL with some else, though they will only be able to complete the experiment once. Participants also have the option to complete part of the experiment and then continue later by using the URL again.

Resend Email Action: From your participants screen you can select the 'resend email' from the Action-menu. This will send the participant an email reminder to take part in your experiment. You may also wish to use this action to encourage participants to continue with their experiment if they have not yet returned to complete it.

Email ID


This recruitment policy allows you to define a list of email addresses for participants. Unlike the 'Email shot', this policy requires you to set up a unique public id for each participant in advance. The email will then contain a generic link to a log in page where the participant must use the public ID. With the link and publicID, the participant would be able to log in again to resume an experiment at a later time. However, nothing prevents the participant from sharing their link and public ID with another person.

Resend Email Action: From your participants screen you can select the 'resend email' from the Action-menu. This will send the participant an email reminder to take part in your experiment. You may also wish to use this action to encourage participants to continue with their experiment if they have not yet returned to complete it.

3rd Party


This recruitment policy allows you to recruit participants via a 3rd party company or organisations.

Please note that for some popular recruitment companies or tools, such as Prolific, Sona Systems and Amazon Mechanical Turk, there are specialised recruitment polices available.


Most participant recruitment organisations will assign each participant a unique ID of their own.

In order to use Gorilla, instruct your recruiter to send each participant to your unique URL, substituting their participant ID for the [PARTICIPANT_ID] field for each participant. Gorilla will use this ID for the participant's PublicID. Gorilla will assume that two participants with the same ID are the same person, and so if they log in again they will continue where they left off. Make sure your recruiter is sending each participant through with a unique ID! Otherwise all your data will be treated as if it came from the same participant.


Third Party Recruitment Services:

Recruitment services frequently used by behavioural scientists and intergrated with Gorilla:

General market research companies that can be used with Gorilla's Third Party Rescruitment Polict to obtain population representative samples or target specific demographics:

Lightspeed

OnePoll

ICMDirect

YouGov

TurkPrime Panels

Precision Sample

SSI

'Free' recruitment options (you take part in others' experiments and they do yours in return):

Prolific


This recruitment policy allows you to recruit participants via the 3rd party tool Prolific.ac.

Use Case: Use this when you want to recruit your participants using Prolific.ac.

You might want to consider encouraging your participants to click the 'Open Study in New Window' button on Prolific so that they get your study fullscreen.

To set up your experiment correctly and connect your Gorilla Experiment to Prolific:

  1. In Gorilla: On your experiments 'Recruitment' page make sure you have selected 'Prolific' as your recruitment policy.
  2. In Gorilla: Copy the Gorilla Experiment URL provided.
  3. In Prolific: Paste the Gorilla Experiment URL provided into the 'Study URL' field in Prolific.

Gorilla automatically captures the Prolific 'Participant ID' and 'Session ID' and stores them in Gorilla as a participant's 'Participant Public ID' and 'Participant External Session ID' respectively. These will then be visible in your Gorilla metrics - you will need to 'Unblind' your data to view the public ID within your metrics.

  1. In Gorilla: On your experiments Finish node(s), under Onward URL, enter your Prolific return URL.

Check your participants regularly!

Prolific allows participants to (1) manually drop out of a study as well as (2) automatically dropping out participants that take longer than a multiple of the average completion time. At the moment, these techniques are not replicated in Gorilla.

This can lead to a disconnect between your recruitment target in Gorilla and in Prolific. Gorilla may think that your experiment has reached its target and won't accept any more entries while Prolific, having registered several dropouts, attempts to send more participants to meet your recruitment target. This can lead to a frustrating experience for the participants!

While Gorilla continues to develop tools for handling participant recruitment and dropout, we strongly recommend the following

  1. Set an Experiment Time Limit on your Experiment's Recruitment Page: this will allow Gorilla to free up spaces in your experiment by automatically rejecting any 'live' participants who take two long to finish your experiment. If you are certain of the length of your experiment or the maximum length you will tolerate a participant taking to finish your experiment, then set your Time limit to match this duration. Otherwise setting your timelimit to 24 hours is usually a good enough measure to account for general attrition.
  2. You may also manually reject participants from you experiment via your participants page. If you need to free up spaces more immediately.
  3. Use Checkpoint Nodes in your Experiment Tree - these will allow you to accurately assess participant progress during the experiment and quickly recognise participants who have stopped or dropped out.
  4. Set your recruitment target to 'Unlimited' if your account allows - this will prevent any problems occuring at all.
  5. Set your recruitment target in Gorilla to be greater than your target in Prolific - this will give you some flexibility in Gorilla to manage with participants who start but do not complete.

Research Now


This recruitment policy allows you to recruit participants via the 3rd party tool Research Now.

Use Case: You can take advantage of Research Now's different completion options: Complete, Quota-full and Screen-out.

To set up your experiment correctly and connect your Gorilla Experiment to Research Now:

  1. In Gorilla: On your experiments 'Recruitment' page make sure you have selected ‘Research Now’ as your recruitment policy.
  2. In Gorilla: Copy the Gorilla Experiment URL provided.
  3. In Research Now: Paste the Gorilla Experiment URL provided into your ‘Survey Link’ field in Research Now.

Gorilla automatically captures the Research Now 'rnid' and ‘survey settings’ and stores them in Gorilla as a participant's 'Participant Public ID' and 'Participant External Session ID' respectively. These will then be visible in your Gorilla metrics - you will need to 'Unblind' your data to view the public ID within your metrics.

To make use of Research Nows 3 distinct completion categories refer to the following additional set up steps:

For participants you wish to count as 'Complete' on Research Now:

  1. In Gorilla: On your experiments design page, use a Finish node(s) as the end point of your Gorilla Experiment. There are no additional set-up steps. You do not need to specify an exit/redirect link within the finish node as Gorilla will do that for you automatically.

For participants you wish to count as 'Screen-out' on Research Now:

  1. In Gorilla: On your experiments design page, use a Reject node(s), There are no additional set-up steps. You do not need to specify an exit/redirect link within the finish node as Gorilla will do that for you automatically.

For participants you wish to count as 'Quota-full' on Research Now:

  1. In Gorilla: On your experiments design page, use a Reject node(s). On the Reject Node configuration options. Set the ‘Rejection Status’ option to ‘Reject – Quota Full’ You do not need to specify an exit/redirect link within the finish node as Gorilla will do that for you automatically.

Sona Systems™


This recruitment policy allows you to recruit participants via the 3rd party tool Sona SystemsTM.

Use Case: Use this when you want to recruit your participants using Sona SystemsTM.

When set up correctly, by integrating your experiment with Sona SystemsTM, Sona will be able to automatically grant credit to your participants upon their completion of your Gorilla Experiment. This eliminates the need for researchers to manually grant credits.

To set up your experiment correctly and connect your Gorilla Experiment to Sona:

  1. In Gorilla: On your experiments 'Recruitment' page make sure you have selected 'Sona Systems' as your recruitment policy.
  2. In Gorilla: Copy the Gorilla Experiment URL provided.
  3. In Sona: Paste the Gorilla Experiment URL provided into the 'Study URL' field in Sona.

Gorilla automatically captures Sona's SURVEY_CODE (an ID provided by Sona that is unique to the participant) and stores it as the participant's Public ID.

  1. In Gorilla: On your experiments Finish node(s), under Onward URL, enter your Sona return URL.

The participant will be automatically granted the credit once they are redirected back to the Sona Systems site.

If you need further information about connecting your experiment with Sona Systems you can view their Support page:
http://www.sona-systems.com/help/gorillasc.aspx

Amazon Mechanical Turk


This recruitment policy allows you to recruit participants via the 3rd party tool Amazon Mechanical Turk (MTurk).

Use Case: Use this when you want to recruit your participants from MTurk.

Your participants will start in Gorilla, once they complete your experiment (by entering a Finish Node) they will then be shown their MTurk completion code.

To connect your Gorilla experiment to MTurk, simply use the Gorilla URL as the URL for your HIT.

Gorilla will automatically show your participants a unique completion code, which they can use to confirm that they have completed the HIT. These completion codes will be included in your data download, so you can check them to ensure that they match those submitted for your HITs


Set Up: How to connect your Gorilla experiment to Amazon Mechanical Turk:

  1. In Gorilla; copy your experiment's URL
  2. In MTurk; use your Gorilla experiment's URL for your MTurk 'HIT'.

Need more detailed information on how to set up Amazon Mechanical Turk with Gorilla?
Check our our MTurk walkthrough here.

Pro Tip!

Sometimes you will not wish to show a participant a completion code, such as when you want to reject a participant.

A Reject Node can be used to end the experiment for that participant, and will not show them a completion code.

Qualtrics


This recruitment policy allows you to recruit participants via the 3rd party tool Qualtrics.

Use Case: Use this when you want to recruit your participants from Qualtrics or else link your qualtrics surveys with your Gorilla experiments.

Your participants will start in Qualtrics, and then be passed to Gorilla to complete the experiment. When set up correctly, a participant's 'Response ID' in Qualtrics will be identical to their PublicID in Gorilla. Allowing you to easily match up data from both systems.

Set Up: How to connect your Gorilla experiment to your Qualtrics survey:

  1. In Qualtrics; in your Survey Flow, add an 'End of Survey element'
  2. Click 'Customise', and under 'Override Survey Options', choose 'Redirect to a URL...'
  3. Enter your Gorilla experiment's URL here as the redirect URL.
  4. In Gorilla; make sure you have selected 'Qualtrics' as your experiment's recruitment policy. This allows Gorilla to automatically capture the parameters provided by Qualtrics.

Qualtrics Panel


This recruitment policy allows you to recruit participants via the 3rd party tool 'Qualtrics Panel'. You can find out more about Qualtrics Panels on Qualtric's website: https://www.qualtrics.com/uk/market-research/panel-management/

Use Case: Use this recruitment policy when you want to recruit your participants from a Qualtrics Panel.

Your participants will need to start in Qualtrics, and then be passed to Gorilla to complete the experiment, before being passed back to the Qualtrics Panel again to flag that they have completed the experiment.

When set up correctly, a participant's 'Response ID' in Qualtrics will be identical to their PublicID in Gorilla. Allowing you to easily match up data from both systems.


Set Up: How to connect your Gorilla experiment to your Qualtrics survey:

  1. In Qualtrics; in your Survey Flow, add an 'End of Survey element'
  2. Click 'Customise', and under 'Override Survey Options', choose 'Redirect to a URL...'
  3. Enter your Gorilla experiment's URL here as the redirect URL.
  4. In Gorilla; make sure you have selected 'Qualtrics Panel' as your experiment's recruitment policy. This allows Gorilla to automatically capture the parameters provided by Qualtrics.
  5. In Gorilla; On your Finish node(s), under Onward URL, enter your 'Qualtrics return URL'.
  6. Gorilla will automatically append the participants's PublicID and other necessary variables to the URL for you, so you can leave Append PublicID blank.

Warning!

Make sure all your Finish nodes redirect back to Qualtrics, otherwise Qualtrics has no way of knowing that they've finished!