Gam­i­fied Research Series: Inves­ti­gat­ing Lan­guage Development

In this inter­view, Pro­fes­sor Dorothy Bish­op talks to us about how she has used games both for teach­ing chil­dren lan­guage as well as for keep­ing them moti­vat­ed in psy­cholin­guis­tics experiments.

Dorothy is a psy­chol­o­gist spe­cial­iz­ing in devel­op­men­tal lan­guage dis­or­ders. She is Pro­fes­sor of Devel­op­men­tal Neu­ropsy­chol­o­gy and runs a Euro­pean Research Coun­cil Advanced Grant in the Depart­ment of Exper­i­men­tal Psy­chol­o­gy at the Uni­ver­si­ty of Oxford.

There is a grow­ing trend for researchers in the field of psy­chol­o­gy to use games in their exper­i­ments. This inter­view is part of a series inter­view­ing pio­neers in the field of gam­i­fied research who have used Gorilla to devel­op their exper­i­men­tal designs.

What led you to gam­i­fied experimentation?

Long before Gorilla exist­ed, I was inter­est­ed in doing psy­chophysics with chil­dren to see how fine a dis­crim­i­na­tion they could make between var­i­ous sounds — because there’s a wide lit­er­a­ture par­tic­u­lar­ly on dyslex­ia and lan­guage dis­or­ders — and the idea that these prob­lems might relate to poor fre­quen­cy discrimination.

What peo­ple were doing was going straight from what was done with adults to doing it with chil­dren the same way, and it was incred­i­bly bor­ing! You need­ed an awful lot of tri­als and you had these adap­tive pro­ce­dures where it got hard­er as you went through, so the more you suc­ceed­ed the hard­er it got. You typ­i­cal­ly need­ed to get adults to do about 100 tri­als to get through this pro­ce­dure and after about three or four tri­als kids would say, “Is there much more of this?”.

The main thing I learned was that to make the task into some­thing the chil­dren would want to do you need sounds. Because we were test­ing sound dis­crim­i­na­tion, peo­ple were very ner­vous about putting in any audi­to­ry rein­force­ment because they thought, “Well, they’re lis­ten­ing to sounds, it’s going to con­fuse them if they get other sounds.” But actu­al­ly it didn’t, because the rein­forc­ing sounds were much more com­plex — more like the sorts of nois­es that are used in games. When the kids got a ques­tion right they had a glid­ing sound that went ‘broop’, and as they got more and more answers cor­rect the sound got high­er in pitch. At the end of a block you got much more excit­ing things hap­pen with car­toon char­ac­ters jump­ing around say­ing, “Well done!” and so on.

Do you think such rein­force­ment strate­gies would work for some­thing educational?

Well the other thing we then moved onto was try­ing to train com­pre­hen­sion. In these train­ing tasks, there are two key things: there’s the rein­forc­ing sounds, which real­ly make a dif­fer­ence, but the other thing is you have to keep them want­i­ng to get to the next level. The trou­ble with most exper­i­ments is they are very repet­i­tive. But we found that if you build in lev­els through which they progress as they learn, it doesn’t actu­al­ly mat­ter if the lev­els are arbi­trary points in a learn­ing sequence; the par­tic­i­pant doesn’t know the change from level one to level two is actu­al­ly just that you’ve done 12 tri­als or some­thing. They see it as progress. The mark­ers of the lev­els need to be some­thing inter­est­ing, so we had char­ac­ters appear­ing on the screen with a mes­sage indi­cat­ing their progress.

I think this could make a huge dif­fer­ence not just to chil­dren but also to adults. I had a PhD stu­dent who stud­ied adults and kids and when we sub­mit­ted our papers for pub­li­ca­tion, we’d get peo­ple say­ing, “Well, you know, this is very child­ish. You’ve got these jump­ing dinosaurs. This is insult­ing to adults.” But of course what we actu­al­ly found is that the adults loved it too. It was so much more fun than the typ­i­cal psy­chol­o­gy exper­i­ment they were asked to do. It also depends where you’re recruit­ing from because, if you’re recruit­ing online, you real­ly need to have some­thing in there to defend against the per­son that’s just going to hit the keys at ran­dom to earn the money: if you can engage them to want to progress, it may help with that.

Were the ideas that you had for these stim­u­lat­ing games from your own intu­ition or from prior evi­dence and experience.

It was main­ly intu­ition, but also expe­ri­ence. When I was test­ing chil­dren in a nurs­ery I would talk to the staff there and ask them, “What do you think would make the kids inter­est­ed?”. And they were able to show me the sorts of com­mer­cial­ly avail­able edu­ca­tion­al games that they were using and that gave me more ideas. But oth­er­wise it was very much intuition.

Do you have any wor­ries that because your exper­i­ments are in a gam­i­fied for­mat, the data might be biased in some way?

Not real­ly. You have to think very hard what it is you’re try­ing to do. In the orig­i­nal psy­chophys­i­cal exper­i­ments we were try­ing to get an accu­rate thresh­old and the big enemy of that is inat­ten­tion. So what­ev­er you could do to get the child attend­ing hard is going to give you a bet­ter thresh­old. I sup­pose the only prob­lem would be if you were com­par­ing dif­fer­ent groups, you may find that some chil­dren found it more moti­vat­ing than other chil­dren, and that might then pos­si­bly be a con­found. For exam­ple if you had some­thing that boys tend­ed to find fun and girls just didn’t you might get a sex dif­fer­ence that did­n’t real­ly reflect their abil­i­ties, but just was down to how engaged they were.

Are there any fea­tures that you would like to incor­po­rate in games that you haven’t been able to?

I think adap­tive­ness, where you are actu­al­ly respond­ing to somebody’s reac­tion time and then giv­ing them feed­back con­tin­gent on that, could be very use­ful. And in terms of what may be miss­ing from exist­ing games and apps I think gen­er­al­iza­tion is impor­tant. When I read the very early lit­er­a­ture on lan­guage dis­or­ders from around the 1960s it was inter­est­ing that there was a lot of rote learn­ing, but there was no gen­er­al­iza­tion to every­day life. So meth­ods start­ed to be devel­oped where a ther­a­pist is very much in a real life sit­u­a­tion respond­ing to a child and they don’t explic­it­ly cor­rect the child, but might repeat what they said with the cor­rect syn­tax and so on. The idea is that this nat­u­ral­is­tic approach is much more effec­tive than rote learning.

Then in the 1990s the first com­put­er­ized remote­ly-deliv­ered inter­ven­tions began to be released, which aimed to teach chil­dren to hear dis­tinc­tions between sounds. Some of these com­put­er­ized inter­ven­tions were beau­ti­ful­ly gam­i­fied but the prob­lem is that most of the evi­dence sug­gests they don’t actu­al­ly work. You can train chil­dren to get bet­ter at the game but it doesn’t gen­er­al­ize. Peo­ple com­ment­ed that we had gone full cir­cle because it was again rote-learn­ing, only this time computerized.

The way we’ve been try­ing to test gen­er­al­iz­abil­i­ty in our exper­i­ments is by chang­ing the for­mat of the of the task. So you might have a learn­ing task where you hear a sen­tence and move things on a screen to match the sen­tence. We also give them a pre and post test which is sim­ply a mul­ti­ple choice test where you have to match a sen­tence to a pic­ture. That way we can look at two things: does the child show learn­ing in the course of the train­ing, but also, does it gen­er­alise to a dif­fer­ent for­mat? I hope that if we get bet­ter at design­ing games that cap­ture chil­dren’s atten­tion, we might also find we can get gen­er­alise beyond the game, but that is the real­ly big challenge.

This inter­view is part of a wider series of inter­views look­ing at gam­i­fied research. Make sure to fol­low these links to have a read through them!

Sid Imanol

Sid is a PhD stu­dent based in the Depart­ment of Exper­i­men­tal Psy­chol­o­gy at UCL. He is work­ing part time with Gorilla cre­at­ing a suite of fun games to col­lect research data to bet­ter under­stand some of the cog­ni­tive mech­a­nisms behind lan­guage devel­op­ment. He is also look­ing at how aspects of gam­i­fi­ca­tion itself can con­tribute to more moti­vat­ed, atten­tive, and ulti­mate­ly suc­cess­ful learn­ing strategies.