Carnegie Mellon University
June 12, 2015

Learning in the Real World Tops Learning From a Tablet

By Susie Cribbs / 412-268-4482 / cribbs@cs.cmu.edu
Tablet Learning

You see it in headlines with more and more frequency: "Local School Provides Tablets for All Students." But though screen technologies are ubiquitous and certainly appealing for children, it's worth asking whether kids still need real-world experimentation with physical objects to enhance their learning. A group of Carnegie Mellon University researchers recently demonstrated that the answer to that question is a resounding yes.

Human-Computer Interaction Institute (HCII) Ph.D. student Nesra Yannier, working with HCII faculty member Ken Koedinger, who also has a joint appointment in the Department of Psychology, and Scott Hudson, designed an experiment that investigated whether 92 children between the ages of 6 and 8 learned more from a mixed-reality (combining physical and virtual worlds) or screen-only educational game, and the effect that adding a physical component (like shaking the screen) had on the students' enjoyment of the activity.

Earthshake game
The "EarthShake" game uses a friendly gorilla and towers made from blocks (below) to teach students principles like stability and balance.

Their findings, "Learning From Mixed-Reality Games: Is Shaking a Tablet as Effective as Physical Observation?" were presented at the recent Association for Computing Machinery’s (ACM) Conference on Human Factors in Computing Systems (CHI2015) and received an Honorable Mention award.

In the experiment, students played one of four versions of "EarthShake," a learning game that uses a friendly gorilla and towers made from blocks to teach students scientific thinking and basic physics principles like stability and balance. The original mixed-reality version of the game includes an earthquake table, the towers, and a projected video game synchronized with the real world via a Kinect depth camera sensing and a specialized algorithm.

Earthshake game 2
Kids see the blocks tumble when an experimenter activates the earthquake table with a switch.

Earthshake game 2At the beginning of the game, the gorilla asks the students which of two towers on the earthquake table in front of them will fall first, and the students use a mouse to select the tower on the projected interface. After collaboratively discussing why they think the tower will fall, the students use a mouse to press the shake button on the projected screen, and an experimenter activates the earthquake table with a switch. Once the tower falls down, the game recognizes the results in the real world and gives interactive feedback accordingly.

If the students chose the correct tower, the gorilla congratulates them and asks them why they think it fell. If they're wrong, the gorilla nicely tells them so. Both groups then select the reason why they thought it fell from a list of possible explanations.

Watch a video of the research in action.

The experimenters developed three variations on the original game to explore how physical interaction affects learning, how enjoyment affects learning and if enjoying the exercise leads to enhanced learning. In the first modification, students played the mixed-reality game but could control the earthquake table themselves with a physical switch — with no experimenter intervention.

In the second modification, students played a screen-only version of the game on a laptop, but answered questions and pressed the shake button with a mouse. In the final variation, students played the screen-only version on a tablet, and could shake the tablet at earthquake time. Testing was done both before and after the game to measure learning.

In the final analysis, Yannier and her colleagues found that the mixed-reality game improved learning by almost five times more than the screen-only alternatives, both in the mouse-controlled and physically controlled conditions. Not only that, but students enjoyed the game more in the mixed-reality conditions. They also determined that simple physical controls like shaking the tablet or pushing the earthquake button did little to improve either learning or enjoyment of the game.

"Mixed-reality games that support physical observation in the real world have a great potential to enhance learning and enjoyment for young children," the researchers concluded. They aim to extend their mixed-reality game to different content areas to create a new educational system that bridges the advantages of physical and virtual worlds to improve children’s science learning, understanding and enjoyment in a collaborative way.

Watch a video of the research in action.

This research is an example of the work being done through CMU’s Simon Initiative. Named for the late CMU Nobel Laureate professor and co-founder of artificial intelligence, Herbert Simon, this initiative harnesses a cross-disciplinary ecosystem of learning science that has developed over several decades at CMU, with the goal of measurably improving student learning outcomes.