Carnegie Mellon University

Eberly Center

Teaching Excellence & Educational Innovation

R&S Digest Header Image

Archive of Past Articles

Collaborative learning in sociology research methods courses: Does race matter?

This study examined the effect of lecture vs. collaborative-based learning on student learning by race in a Sociology course on Research Methods. Students enrolled in a lecture-based course (n = 76), in which the majority of class time was structured around a lecture with occasional questions for students, or a collaborative-based course (n = 51), in which students read material before class and then completed collaborative activities to apply course material in groups. Students took a pre- and post-test, consisting of 13 multiple choice questions, seven short answer, and one essay question about research methods. Although there were no significant overall differences between pre and post-tests in the lecture vs. collaborative-based courses, there was a difference in African American students' performance between course types. Controlling for socio-demographic information, gender, parental education, and employment status, regression models indicated that African American students' predicted post-test scores were 22 percentage points lower compared to White students in the lecture-based course, yet this difference did not appear in the collaborative-based learning course. While further research is needed to better understand the effects of collaborative learning based on race, this study suggests that collaborative-based learning has the potential to close the gap in student performance in higher education. 

Morris, P., Ida, A. K., Migliaccio, T., Tsukada, Y.,  & Baker, D. (2020). Teaching Sociology, 48(4), 300–312. 

[link to article]

Learning in double time: The effect of lecture video speed on immediate and delayed comprehension

Is watching lecture videos at an increased speed effective for learning? In three experiments, the authors had participants watch lecture videos at 1x, 1.5x, 2x, and 2.5x speed, followed by immediate and delayed comprehension tests. When it came to watching a video one time at a particular speed, results showed that learning was not significantly different depending on whether the participant watched at 1x, 1.5x, or 2x speed, but performance did decline while watching at 2.5x speed. After watching each video and before taking a test, participants were asked to predict how well they would do on the tests, and the video speed did not have an effect on these predictions. In a second experiment, the authors tested whether watching the same video twice (back to back) at 2x speed would lead to more or less learning than watching it once at 1x speed (i.e., time on task was identical). In this case, participants who only watched the video one time at 1x speed had higher expectations of performance than participants who watched twice at 2x speed, but there were no differences in their actual performance. When the participants who watched twice at 2x speed were able to space out their viewings, however, watching the video for the second time right before the test, they did perform better than individuals who only watched once at 1x speed. This finding is consistent with research on the spacing effect. Overall these results suggest that (for videos featuring around 150 words per minute at 1x), watching lecture videos at up to 2x speed does not incur a significant cost when it comes to comprehension of the content.

Murphy, D. H., Hoover, K. M., Agadzhanyan, K., Kuehn, J. C., & Castel, A. D. (2022). Applied Cognitive Psychology, 36(1), 69-82.
[link to article]

Up close and personal: Examining effects of instructor video presence on student’s sense of connection

Students' sense of connection with instructors is something that has been of concern since the shift to a mostly remote learning environment, where recorded lecture videos are a frequent course medium. Even as in-person learning comes back into the fold, the use of recorded lecture videos is an element from the shift to remote learning that may be retained in some capacity for many instructors. The authors of this paper conducted two studies in which they had students watch a segment of an introductory psychology lecture that was recorded in different ways. Students either watched the lecture recorded with the instructor looking at and speaking directly into the camera, from a more distant vantage point of the camera embedded in the lecture hall (instructor present but not speaking into the camera), or a clip with audio only. After watching the lecture video, students were asked to complete several measures, including the overall likeability of and likelihood of certain behaviors from that instructor (e.g., this instructor would invite students to call or meet outside of class if they have questions or want to discuss something), perceptions of the instructor’s knowledge, and questions about how the students would feel in that class (e.g., connection to and comfort with the instructor). Results showed that, when compared to the lecture hall video and audio-only clip, students who watched the eye-contact video rated the instructor as more likable and more likely to engage in a series of positive behaviors, but did not perceive the instructor as more knowledgeable. In addition, students who watched the eye-contact video reported being more likely to have a series of positive feelings in that class, including feeling connected to the instructor and feeling comfortable raising their hand. Interestingly, the lecture hall video where the instructor was present (but not speaking into the camera) did not show advantages in these measures when compared to the audio only group. These results suggest that being able to view the instructor’s eyes and facial expressions up close in lecture videos may be beneficial for facilitating a positive learning experience for students.

Wong, M., Marshall, L. M., Blank, H. C., & Hard, B. M. (2021). Scholarship of Teaching and Learning in Psychology
[link to article]

Effects of collaborative versus individual preparation on learning by teaching

Evidence suggests that students benefit from teaching others. This study investigated how 1) collaboratively vs. individually preparing to teach, and 2) teaching vs. being taught impacted student learning. Undergraduate students (n = 92) were randomly assigned same-gender pairs, in which they had to prepare and teach a psychology lesson on social loafing and coordinator loss. Pairs were assigned to a Collaborative Preparation (CP) condition (n=23 pairs) or an Individual Preparation (IP) condition (n=23 pairs). Participants completed a pre-test measuring prior conceptual knowledge. Pairs then read and prepared an explanation about the concepts. CP participants were able to collaborate with their partner to design the explanation, while IP participants worked individually. Next, one participant was randomly assigned to explain the material, while the other participant listened. After the presentation, students completed a post-test with the same items from the pre-test, as well as eight inference questions and two transfer questions. Researchers then scored students' explanations based on comprehensiveness (i.e., including statements from the text in their explanation) and quality of conceptual statements and interpretations. Results indicated that there were no significant differences in conceptual knowledge and transfer across either condition, between students who explained vs. listened. However, explainers in the CP condition did include higher-quality result interpretations after working collaboratively, and the quality of explainer participants' explanations significantly predicted learner outcomes. In other words, results support the idea that collaboration before teaching promotes better explanations and deeper processing of learning materials when learning by teaching.

Kobayashi, K. (2021) Instructional Science, 49, 811–829.
[link to article]

Diversity interventions in the classroom: From resistance to action

This paper presents a framework for understanding and providing support for faculty resistance to implementing diversity-enhancing interventions in their classrooms. As empirical support for low-cost diversity-enhancing interventions with potentially long-term effects grows, understanding how faculty think and make decisions about these issues is necessary in order to achieve successful implementation of these strategies at scale. A sample of 40 biology faculty were surveyed and given in-depth, semi-structured interviews which led to rich qualitative narratives that provided insight on the faculty thought and decision process. The resulting framework has four key inputs for faculty in the decision process: 1) noticing underrepresentation is a problem in their field; 2) interpreting underrepresentation as requiring immediate action; 3) assuming responsibility; and 4) knowing how to help. The details of these inputs are analyzed and discussed throughout the paper. The authors argue that faculty are the systemic gatekeepers to widespread use of interventions designed to close equity gaps, and such interventions are not likely to be widely implemented without further scrutinizing and engaging with the faculty decision-making mindset.

Thoman, D. B., Yap, M. J., Herrera, F. A., & Smith, J. L. (2021). CBE—Life Sciences Education, 20(4), ar52.
[link to article]

Scrum methodology in context-based secondary chemistry classes: effects on students’ achievement and on students’ perceptions of affective and metacognitive dimensions of their learning

Three principles underline Scrum methodology: transparency, inspection and adaptation. These principles suggest its' use may help students' metacognitive and executive function skills and initial anecdotal evidence seems to suggest this. This study is meant to be a more formal exploration on Scrum's effects on learning.
10 teachers in the Netherlands teaching a total of 320 students were separated into two groups, one group of 6 teachers would teach their Chemistry module implementing Scrum, while the other 4 would teach as normal. The Scrum teachers attended Scrum training sessions. This group would be later separated into four teachers who had trouble implementing Scrum into their classrooms (growth teachers) and two who did not (top teachers). The Scrum curriculum was split into three sprints of two weeks each, with each sprint having a collection of learning tasks to be completed on scrum board and students choosing who would complete what. Each sprint ends with a formative assessment for students to receive feedback on their understanding of the concepts, followed by a debriefing where students reflect on how to improve learning and collaboration for the next sprint.
Results showed that compared with the control group, the students from the top teachers achieved a large effect size increase in post test scores and the growth teachers achieved medium effect size increases. This is particularly remarkable when considering the growth teachers felt like they had trouble implementing Scrum in their classrooms, as well as the fact that all the teachers had only recently learned about Scrum. Top teacher students also showed significantly higher scores on learning climate, self-regulation, attitude towards chemistry and collaboration, whereas growth teacher students showed significantly higher scores on self efficacy and attitude towards chemistry. The control group showed no significant increases.
The authors acknowledged the fact that the study didn't differentiate the components of Scrum and thus did not know which component affected which result and that there was potential bias in the fact that teachers were put into the treatment or control group based on their interest in getting Scrum professional development. They hope further studies can shed more light on these areas.

Vogelzang, J., Admiraal, W.F. & van Driel, J.H. (2021). Instr Sci 49, 719–746 .
[link to article]

Considering the effects of assignment choices on equity gaps

A disproportionately high number of students leaving college without degrees are from underrepresented ethnic minority populations (URM) and transfer students. One contributing factor in leaving college is low grades on assignments, which can negatively influence students' sense of self-efficacy and belonging. In order to better understand the effects of different assignments, this article investigates whether certain assignment types were associated with inequitable grade distributions for underrepresented minority (URM) and transfer students. Researchers analyzed 745 students' final grades and scores on different assignments across 8 courses. Assignments were divided into six categories: exams, quizzes, or tests; homework; writing; group projects; class activity; oral report. All grades (final grades and across each type of assignment) were lower for URM and transfer students than for non-URM and non-transfer students. In particular, there were significant differences in grades on multiple choice quizzes and exams, homework involving reading, and writing assignments. While not all differences in grades were significant, authors argue that lower grades in general can negatively affect URM and transfer students. To create more equitable assessment practices, instructors should carefully select and use a variety of assignment types, create assignments that are professionally, personally, or academically useful, and provide clear and detailed instructions and rubrics.

Hobbs, H. T., Singer-Freeman, K. E., Robinson, C. Research & Practice in Assessment, 16(1) 49-62.
[link to article]

Uncertain instruction: Effects on curiosity, learning, and transfer

Research suggests that instruction with uncertain elements can promote learning and transfer better than instruction that is certain. In addition, research on curiosity suggests that uncertainty is a key trigger, and that curiosity can motivate learning. However, educational research has not looked into the link between uncertainty, curiosity and learning at the same time, nor has it looked into curiosity on the specific task at hand (state-level), focusing more on it as a personality trait, which is far harder to manipulate and increase.The study took n=208 7th and 8th graders from 10 classes in New Jersey with a 96% Hispanic demographic. Students were asked to derive the formulas of Hooke's Law and Newton's Second Law through experimentation over a course of 4 days. The Low Uncertainty (LU) group were given information about and examples of formulas while the High Uncertainty (HU) group received information not directly related to their learning task. The tasks were followed with direct instruction on the 3rd day and a learning posttest and transfer posttest on the last day.

The study showed that while the HU group had higher state level curiosity on the first day compared with the LU group, both groups state level curiosity decreased as the days went on and became equal by the end of day 2. This suggests that students naturally become less curious as they learn more about a topic. On a post-test, there were no group differences for retention, but the HU group showed a significant benefit for transfer compared with the LU group. The authors suggest that uncertain situations may help learners adapt to other uncertain situations, such as transfer tasks. They conclude by hoping that further studies can find the sweet spot of how much uncertainty to include in instruction and the negative effects of such instruction.

Lamnina, M., Chase, C.C. (2021) Instructional Science 49, 661–685.
[link to article]

Multimedia effects during retrieval practice: Images that reveal the answer reduce vocabulary learning

Multimedia learning theory has shown that providing (relevant) images and words together can benefit learning, and in some instances has even shown that student recall is better when items are presented as images alone rather than words. Importantly, however, this multimedia effect may vary based on whether the student is in the encoding or retrieving phase of learning. In three experiments (N=293), this research provides evidence that including images during retrieval practice may hinder learning. The presence and timing of images was experimentally manipulated for secondary school students (mean age approx. 13 years old) during retrieval practice for foreign language vocabulary that they had been exposed to previously. The foreign words were presented to the students in one of three ways: by themselves (condition 1), with an accompanying image that provided a hint for the words’ translation (condition 2), or by themselves with the image appearing after their retrieval attempt (condition 3). Results showed that recall was significantly better for students who practiced retrieval with no images, compared to those who had images accompanying the foreign words or those who had images presented after retrieval. In addition, students overestimated how helpful the images were, perceiving the images as helpful when in fact they were a hindrance to their learning. These findings suggest that although providing both words and images may be beneficial for learning while encoding, it may have a negative impact during retrieval practice.

van den Broek, G. S. E., van Gog, T., Jansen, E., Pleijsant, M., & Kester, L. (2021). Journal of Educational Psychology. Advance online publication.
[link to article]

The importance of adolescents' sense of belonging to mathematics for algebra learning

Sense of belonging has been shown to influence student learning, especially among underrepresented minority (URM) students. Sense of belonging may be particularly important in mathematics, where there is an achievement gap between URM students (Black, Latinx, and Native American) and non-URM students (defined as White and Asian in this study). Through a survey and pre and posttest, this study examined the predictive utility of sense of belonging to mathematics, on middle-school algebra students' (N=206) performance. Students took a survey measuring their sense of belonging to math, math self-concept, perceptions of math importance, interest in math, and entity view of math. Students then completed a pre-test, a lesson on quadratic equations, and a posttest. The study also controlled for socioeconomic status (SES), gender, and URM status. Results indicate that sense of belonging and URM status were the only significant predictors of posttest scores. URM students had a significantly lower sense of belonging and lower posttest scores; however, URM students did not differ from non-URM students on prior knowledge, math self-concept, perception of math importance, interest in math, or entity view of math. In addition, URM students' lower sense of belonging accounted for some of the differences in posttest scores (controlling for SES and prior math knowledge). In summary, a sense of belonging to math was a significant predictor of algebra learning for all students. Lower sense of belonging was related to lower posttest scores for URM students. These differences could not be accounted for by prior knowledge, SES, interest in math, perception of math importance, math self-concept, or entity view of math. Fostering students' sense of belonging can be an influential factor in supporting student learning.

Barbieri, C.A., Miller-Cotto, D. (2021). Learning and Individual Differences87, 101993.
[link to article]

Increasing intercultural competence among psychology students using experiential learning activities with international student partners. 

This research examines the impact of an experiential learning approach called Crossing Borders on students' intercultural competence. The Crossing Borders program, part of a cultural psychology course, facilitates the grouping of domestic (U.S.) and international students together to participate in a series of in-class and out-of-class experiential learning activities during a semester (see examples in the appendix of the paper). The goals of the Crossing Borders program are for students to become more self-aware of their own cultures, learn about the cultures of other group members, and practice the skills and empathy needed to meaningfully converse with others that have different cultural backgrounds. Data was collected over 8 years (n=207) using pre- and post-measures of intercultural competence that tap three different domains (cognitive, intrapersonal, and interpersonal) with two subscales within each domain. Pre- and post-scores, along with supplemental narrative analyses from some students' writing, revealed significant increases in subscales for cognitive (knowledge) and intrapersonal (identity) areas. In addition, narrative analysis indicated three different themes regarding the positive impact of the Crossing Borders program: breaking down barriers, self-awareness, and awareness of others.

Wickline, V., Wiese, D. L., & Aggarwal, P. (2021). Scholarship of Learning in Psychology. Advance online publication.
[link to article]

Integrating Rubric-Based Metacognitive Reflection to Improve Scientific Research Presentations

Researchers describe the process they implemented for helping research students develop presentation skills and share the rubric they used to provide feedback to students. Eleven students in the study gave two research presentations, for which a trait analytic rubric was used for 1) self, 2) peer, and 3) instructor evaluation and feedback. After the first presentation, students were given the chance to discuss the feedback with their research mentor, and identify areas for growth before the next presentation. Overall, student scores on all three evaluations improved significantly between the first and second presentations. Although the methods and results of this study are not completely novel, it provides a helpful description of their process, as well as a solid rubric for student presentations in a STEM context. This article may be particularly interesting for undergraduate research mentors.

Gunderson, J. E. C.; MacDonald, L. J., Gunderson., W. A. (2021). Journal of Chemical Education.
[link to article]

Ultra-Short Presentations with Immediate in-Class Public Feedback to Enhance Skill Development with Low Class Time and Instructor Time

The performance of in-class oral presentations can be time-consuming, intimidating for some students, and typically has a low amount of feedback relative to the time it takes for students to prepare and perform their talks. In this research students received repeated opportunities to perform 1-minute presentations throughout the semester. Each presentation received either one positive comment only, or an additional suggestion of something to work on. Preparation for these talks usually took place in class for only 8 minutes. The short duration of preparation and performance gave students the opportunity to experiment with new speaking strategies in a low-stakes environment. It also meant that there was much more time available for students to have additional, new opportunities to present throughout the semester. The limited amount of feedback helped students focus on a single, actionable suggestion. The process also alleviated performance anxiety for students by habituating them to the experience through multiple, low-stakes opportunities while the instructor also assessed the student audience for their supportive listening behaviors. This alleviated some of the pressure from students with less experience speaking in front of peers. Immediate and delayed surveys showed that students valued this process, that it helped them feel less stressed about presentations, and that they believed they learned more about presenting than other students that they knew.

Heideman, P. D., & Laury, J. E. (2021). College Teaching, 1-10.
[link to article]

Moonshot: Redesigning NASA's High School Aerospace Scholars Experience at Johnson Space Center for Online Delivery

This article describes a case study on the NASA STEM Pathway Activities--Consortium for Education's High School Aerospace Scholars program (HAS). Under normal circumstances, HAS ends its program with an all-expense-paid trip to the Johnson Space Center. Due to the pandemic, however, this interaction was forced to move online. The HAS team chose to do this through a gamified version of sending the first woman and another man to the moon by 2024. The article details the various learning technologies used to achieve this, as well as some key feedback from students, including the importance of a more concrete schedule and deadlines, the use of smaller teams, and accountability issues. The authors also discuss various aspects of the in-person program that were lost due to the online format.
Neumann, K. L., Stansberry, S. L., Del Rosso, C. L., Welch, S. S., & Ivey, T. A. (2021). International Journal of Designs for Learning, 12(1), 140-157.

Fostering Metacognition to Support Student Learning and Performance

Helping students develop metacognitive skills to support their learning is important, but it is also challenging. Designing and implementing interventions in this area is often difficult due to there being a very broad, noncohesive research landscape, coupled with the fact that a student's thoughts, which are often implicit in nature, are difficult to measure. This paper provides a summary of some of the key research findings on student metacognition, and translates that work into generalizable instructional recommendations. The authors also created a website resource that provides summaries of relevant research papers and organizes all of the information from the paper into a highly accessible evidenced based teaching guide.
Stanton, J. D., Sebesta, A. J., & Dunlosky, J. (2021). CBE—Life Sciences Education, 20(2), fe3.
[link to article]

An inclusive pedagogy in Arts and Humanities university classrooms: What faculty members do.

Inclusive teaching strategies are at the forefront of many higher ed conversations, including how to support students with disabilities. In this qualitative study, students with disabilities identified instructors that they felt were supportive and created engaging, inclusive environments in their classrooms. Instructors (n=119) were then contacted and asked to participate in individual semi-structured interviews about classroom practices, in particular for students with disabilities. Results focused on the humanities instructors (n=24). Interview data was coded and two major categories were identified - teaching-learning process design and methodological strategies. Results indicated that one of the main elements that the instructors had in common was the planning process before the semester and their communication to students at the beginning of the semester about the course schedule and expectations, especially for students with disabilities. to allow them to plan and prepare for the semester. Faculty also expressed the importance of getting to know students in order to adjust course materials for student needs. For students with disabilities, this involved a direct and continuous conversation about their specific needs. In terms of teaching methodology, instructors highlighted the need for active learning, and in particular, group work. Instructors emphasized the importance of group work to recognize students' unique abilities and promote more equality among students. Finally, instructors discussed flexibility, when appropriate and possible, for all students, but especially students with disabilities.

Carbello, R., Cotán, A., & Spinola-Elias, Y. (2021). Arts and Humanities in Higher Education, 20(1), 21-41.
[link to article]

Testing (quizzing) boosts classroom learning: A systematic and meta-analytic review. 

In the laboratory, the 'testing effect' is one of the most robust and well-documented interventions to enhance student learning. As we all know, however, real-life classrooms are often far 'noisier' environments than what is typically experienced in the lab. To reconcile this issue, the present research examines data collected from over 48k students in over 200 independent studies to better understand how the testing effect works (e.g., effect size, moderators, theoretical mechanisms, etc.) in a live classroom setting. Results from a meta-analytic review reveal a moderate overall effect size (approx d=.5), as well as evidence for several moderating variables (e.g., feedback given, frequency of testing). In addition, support for several theoretical mechanisms was found, including transfer-appropriate processing, and increasing motivation to learn unknown material, but not for retrieval effort. These results provide strong empirical evidence for the effectiveness of the testing effect 'in the wild' and provide a glimpse into how instructors can enhance implementation in their practice. A table on page 7 of the paper provides a convenient summary of all of the research questions that are addressed along with their corresponding findings.

Yang, C., Luo, L., Vadillo, M. A., Yu, R., & Shanks, D. R. (2021). Psychological Bulletin. Advance online publication.

Gouvea, J. S. (2020). Antiracism and the problems with "achievement gaps" in STEM education

Measuring and defining "achievement gaps" in STEM teaching often promotes a comparison that holds white students as the norm or as the ideal learners. The authors have identified that this, itself, is a problematic practice that promotes racist ideas and standards. This review article examines "a small collection of recent work [that may] stimulate critical reflection on what we [biological science instructors] mean by “achievement” in STEM, how we can understand the causes of “gaps,” and what we might consider to be productive steps toward racial equity and justice."

Gouvea, J. S. (2020). CBE-Life Sciences Education, 20(1).
[link to article]

Syllabus tone, more than mental health statements, influence intentions to seek help

With the rise of mental illness cases on college campuses, providing and encouraging the use of resources for students using course syllabi is an important practice. The authors of the present research examined the effects of two syllabus variables on the likelihood that students would reach out to the instructor for help if needed. In a 2x2 lab experiment, syllabi were manipulated to have the presence or absence of a special statement addressing mental health, and had either a warm tone or a cold tone. Participants read one of the four types of syllabi and then rated their intentions to reach out for several different kinds of help if needed. Controlling for attitudes toward seeking psychological help, results showed that, overall, both having a statement addressing mental health and having a warm tone can influence student intentions to reach out to the instructor for help, although the effects of the warm tone appeared to carry influence in several types of situations whereas the presence of the mental health statement affected only one. These results suggest that having a warm tone in your syllabus may encourage students to reach out to instructors for help in more types of situations than simply including a statement about mental health.

Gurung, R. A., & Galardi, N. R. (2021). Teaching of Psychology, DOI:0098628321994632
[link to article]

Play like a team in teams: A typology of online cognitive-social learning engagement

The majority of prior research in online learning and student engagement has focused on cognitive, quantitative aspects of online interaction, e.g., number and length of forum contributions. The authors propose that the analysis of online learning environments should include a social lens. They performed a qualitative assessment of over 3,500 discussion posts from 181 students in an online course, in which they reviewed the number of posts made by each student, as well as the length, depth, and conversational sophistication of each post. They also considered the interactive properties of the posts, e.g., turn-taking and concept building. They produced a matrix of participatory categories using team-based language borrowed from the sports world. Bench-sitters post infrequently, using low complexity writing or reactions. Hustlers post or respond frequently, but also with low complexity writing. Strikers post infrequently, but write with high complexity and in collaboration with peers. Champions write frequent, high-complexity posts that also play to the community. By considering the social aspects of engagement, the authors created a framework that expands how online designers may understand their learners, and be able to build activities that are more reflective of the given population of learners. Building assignments this way may help reach students who struggle with engagement.

Prestridge, S., & Cox, D. (2021). Active Learning in Higher Education, 1–18.
[link to article]

It matters how to recall–task differences in retrieval practice

Although retrieval practice has clear evidence of helping students remember learning material, less study has been focused on the type of retrieval practice. The present research shows the type of recall task used may substantially influence the effects of learning by retrieval practice. Students were split up and read two texts, followed either 12 short answer questions or a free recall question. Students were also given a survey that asked about their mental effort and self-efficacy. After a one-week delay, the students took a post-test with short answer and free recall questions. Results found that the short answer and free recall formats had different strengths. Short answer format led to more successful retrieval of targeted information and increased students’ calibration of meta-knowledge (knowing what they know), and free recall was associated with increases in students’ self-efficacy and learning of general sub-content not targeted directly by the short answer prompts. This article shows the usefulness of both targeted short answer questions and more open-ended holistic questions, albeit for different purposes. Educators should consider either type, depending on the context of their learning outcomes.

Endres, T., Kranzdorf, L., Schneider, V., & Renkl, A. (2020). Instructional Science48(6), 699-728.

[link to article]

Comparing Mastery-based Testing with Traditional Testing in Calculus II

Mastery-Based Testing (MBT) is a new form of assessment that builds on prior work in mastery learning techniques. It requires students to show complete mastery of course concepts in order to achieve credit for each of those concepts. Passing grades are only granted when students master a subset of core concepts. Additional concept mastery adds to the final grade. The motivation for this work is to use theories in growth-mindset to improve student learning. This quantitative study compared students across semesters in a Calculus II class who received either traditional assessments or MBT. A significantly higher number of students in the MBT courses finished the semesters with an A. They also reported spending significantly less time studying per week while also achieving a deeper understanding of the material than their counterparts did.

Harsy, A., & Hoofnagle, A. (2020). International Journal for the Scholarship of Teaching & Learning, 14(2).

[link to article]

Example-based learning: should learners receive closed-book or open-book self-explanation prompts?

Self-explanation is an empirically backed technique that students can use to help make connections between old and new material or a concept and an application of the concept they are learning. Less is known, however, about whether this should be done in a closed- or open-book format. Authors conducted two 2x2 experiments to examine the effects of having to self-explain newly learned concepts in either an open- or closed-book format, with the students either being prompted to actively process the important content or not. Results found that when not prompted to actively process the main content, closed book self-explaining elicited fewer self-explanations and led to lower scores on the immediate and delayed posttest.  When prompted to actively process the main content (through the use of a guiding question), however, the detrimental effect of the closed-book format disappeared, but performance did not exceed that of the open-book format. These results suggest that closed-book self-explanation formats are not advantageous and may even be detrimental in some circumstances. The authors also suggest that further studies should be done to see if any of these results might change following a longer retrieval period.

Hiller, S., Rumann, S., Berthold, K., & Roelle, J. (2020). Instructional Science48(6), 623-649.

[link to article]

Effectiveness of guided group work in graduate level quantum mechanics

In a non-randomized study of graduate students taking a quantum physics course, students who voluntarily attended a structured, weekly, group work session (using Peer Led Team Learning principles) achieved higher gains between a pre and post assessment than their peers who did not attend. Students who attended two or more sessions showed even higher gains. The selection bias was explored as a confounding factor, and the results were still significant. This study shows that PLTL group work sessions, which have previously been shown to be helpful for undergraduate learning, are also helpful for more advanced graduate students, and discusses some considerations unique to this audience.
Porter, C. D., & Heckler, A. F. (2020). Physical Review Physics Education Research16(2), 020127.

A psychological intervention strengthens students’ peer social networks and promotes persistence in STEM

Although values affirmations are typically only focused on the individual's knowledge, skills and beliefs to improve persistence (e.g., in STEM), persistence has been shown to be strongly impacted by a social/relational component. The present research draws an important connection between students' relational networks and receiving a values-affirmation treatment. Students who received the values affirmation intervention were more likely to make new friends by the end of the semester, and were more central in their social networks than students who did not receive the intervention. These changes in social networks, in turn, were the driving mechanism behind students' persistence in future courses. The concept of targeting students' social networks with values affirmation interventions, or other similar efforts, ties very nicely into the present increased focus on the importance of psychological climate, not just individual knowledge, skills, and beliefs for fostering student success and equity. This research further informs our understanding of values affirmations, as well as presents a potentially important target for faculty (social/relational systems) to incorporate into their course design.
Turetsky, K. M., Purdie-Greenaway, V., Cook, J. E., Curley, J. P., & Cohen, G. L. (2020). Science advances6(45), eaba9221.

Teaching with social media: Evidence-based strategies for making remote higher education less remote

The authors provide a literature review of social media’s use in remote learning in order to provide some research-based guidelines for instructors looking to strategically leverage the use of social media in their courses. The paper goes into detail about the utility and instructional affordances social media can provide, and offers evidence-based guidelines for instructors who may be looking to complement their existing online teaching approaches.

Greenhow, C., & Galvin, S. (2020). Information and Learning Sciences, 121(7/8) 513-524. 

[link to article]

Training learning strategies to promote self-regulation and transfer: the knowledge, belief, commitment, and planning framework

Unfortunately, many students often report the use of relatively ineffective study strategies. This paper presents a practical framework for guiding the training of students’ learning strategies in ways that will lead to their effective use across a range of content. The framework has four essential components: knowledge, belief, commitment, and planning (KBCP). The authors provide a thorough review of research related to each component, and argue that they must be considered together in order to create a coherent, evidence-based training approach. After summarizing these key components, the authors provide a sample training protocol that can be implemented in a classroom setting.

McDaniel, M. A., & Einstein, G. O. (2020). Perspectives on Psychological Science

[link to article]

Escape the (Remote) Classroom: An Online Escape Room for Remote Learning

This paper highlights a free, innovative approach to remote learning through the use of Google forms to create a virtual room escape game. Students could work together to solve chemistry-based puzzles and advance from “room to room”. More specific details are included in the supplementary information document that accompanies the manuscript (linked below and attached). Students were asked about the experience and reported enjoying the simulation and thought it was a good experience in cooperative learning. There was little to no reporting of partitioning tasks, suggesting that students remained engaged in a collective effort throughout. Students also provided some other feedback regarding the ideal time it should take to solve each puzzle and the ideal total number of “rooms” needed to make the final escape.

Vergne, M. J., Smith, J. D., & Bowen, R. S. (2020). Journal of Chemical Education97(9), 2845-2848.

[link to article]

A learning method for all: The testing effect is independent of cognitive ability

Retrieval practice, or the testing effect, is a robust technique for enhancing learning, although research on its effectiveness in the context of individual differences in cognitive ability is limited. Experiment 1 (N=324) tested retrieval practice compared to restudying across varying levels of cognitive ability at three different testing intervals, and experiment 2 (N=84) used fMRI to examine the brain activity of some participants from experiment 1 at a one-week interval. Results showed no differences in the effectiveness of retrieval practice across different cognitive abilities, and participants were shown to have significantly higher brain activity patterns in the predicted regions for content learned through retrieval practice compared to restudy. The authors argue that due to its easy-to-implement nature and seemingly universal level of cognitive effectiveness, retrieval practice should be a must-have in all teachers’ toolkits.

Jonsson, B., Wiklund-Hörnqvist, C., Stenlund, T., Andersson, M., & Nyberg, L. (2020). Journal of Educational Psychology. Advance online publication. 

[link to article]

Attention Matters: How Orchestrating Attention May Relate to Classroom Learning

This paper presents a new framework for understanding how students pay attention while learning. This framework organizes student attention along two dimensions: internal/external, and on-topic/off-topic. The authors explore these dimensions in the context of classroom learning and apply the framework to several common classroom scenarios. The authors also provide tips for how instructors may leverage students’ attention in the classroom. In particular, it is hoped that this perspective will help shed light on the underlying mechanisms that affect active learning and provide insight for why certain implementations may be more successful than others.

Keller, A. S., Davidesco, I., & Tanner, K. D. (2020). CBE—Life Sciences Education19(3), fe5.

[link to article]

Optimizing the Efficacy of Learning Objectives through Pretests

We all know the importance of learning objectives (LOs) for aligning classroom content and assessments with desired outcomes, but what about their effects on the learning itself? In 3 experiments, (total N=516), the authors show how LOs can be beneficial for students’ learning, and provide evidence for how they can be optimally leveraged in an active fashion. In experiment 1, students who were presented with LOs prior to reading passages performed better on a posttest than students who did not see the LOs. In experiment 2, participants performed better on the posttest when LOs were presented in the form of pretest questions to be answered by the participants, compared to how they were presented in experiment 1. Experiment 3 expanded on the findings from experiment 2 with a 2x2 design, providing students with pretest LOs that were either multiple choice (MC) or short answer (SA), and either provided feedback on the pretest, or did not provide feedback. Results did not show a significant difference in posttest performance between the MC and SA formats, but did show a significant main effect of feedback – students performed better on the posttest when they did notreceive feedback on their pretest LO questions. These findings, as well as limitations of and future directions for this work, are discussed.

Sana, F., Forrin, N. D., Sharma, M., Dubljevic, T., Ho, P., Jalil, E., & Kim, J. A. (2020). CBE—Life Sciences Education19(3), ar43.

[link to article]

A metacognitive retrieval practice intervention to improve undergraduates’ monitoring and control processes and use of performance feedback for classroom learning

This paper provides an example of a practical skills training intervention that can help students better monitor and improve their learning. A classroom study of 103 students examined the effects metacognitive control and retrieval practice training on learning outcomes, metacognitive awareness, and practice habits. Throughout the semester, students received a series of practice assignments and feedback assignments that required the students to self-report their monitoring of their learning. Half of the students were randomly assigned to learn about the benefits of retrieval practice, self-regulation strategies, and evaluation of feedback, and half of the students completed a series readings and activities aligned with the course content. Results showed that students who received the metacognitive training intervention scored higher on novel exam items and this effect was mediated by monitoring accuracy of to-be-learned materials. These results suggest that, compared to spending additional time studying the course content, time spent on developing metacognitive skills can lead to better learning outcomes.

Cogliano, M, Bernacki, M.L., Kardash, C.M. (2020).  Journal of Educational PsychologyDOI: 10.1037/t21885-000

[link to article]

A change of scenery: Does the setting of an instructional video affect learning?

The setting of instructional videos (e.g., authentic to the context or neutral) has been theorized to be a potential learning distraction and, conversely, a potentially helpful retrieval cue. This research tested several hypotheses relevant to those theories that examined the effect of instructional video settings on retention and application of learning content. In two experiments (N=208), instructional videos that were shot in either an authentic setting (e.g., video about flowers shot in a greenhouse) or a neutral one (i.e., a white wall), were viewed by students who then completed tests for retention and application of concepts. One experiment showed increased retention for the authentic setting, but this was not replicated in the other experiment. The results otherwise failed to show benefits for the videos being shot in an authentic setting, although future research is needed to investigate possible boundary conditions where setting may play more of a role.

Merkt, M., Lux, S., Hoogerheide, V., van Gog, T., & Schwan, S. (2020). Journal of Educational Psychology, 112(6), 1273–1283.

[link to article]

Assessing why the testing effect is moderated by experimental design

Although research on the “testing effect” has repeatedly demonstrated that memory for learning material is enhanced by prior testing compared to prior restudying, there have been a variety of experimental designs that have enhanced, reduced, and even reversed this effect. This paper examines these critical differences in an attempt to gain a more complete understanding of the mechanisms at work when testing effects are produced. Three different accounts of these mechanisms were tested (item-order, rehearsal-borrowing, and retrieval distinctiveness). In three experiments (N=134), the researchers found evidence for rehearsal-borrowing, but not item-order or retrieval distinctiveness. This research provides an incremental advancement in testing effect research, and can be used aid future experimental design and understanding patterns of findings that are otherwise considered inconsistent. 

Mulligan, N. W., Buchin, Z. L., & West, J. T. (2020). Journal of Experimental Psychology: Learning, Memory, and Cognition, 46(7), 1293–1308.

[link to article]

Four empirically based reasons not to administer time-limited tests

Although the use of time-limited tests (TLTs) in college courses is a time-honored practice at most institutions, the authors of this paper present four empirically based reasons why the use of such tests may not be in the best interest for the goals of higher education. They argue that TLTs fall short of providing equitable opportunities to be evaluated fairly and often lead to confounded measurements of learning that have questionable legitimacy. The four reasons (elaborated on at length in the paper) for using untimed tests instead of TLTs are 1) TLTs are less valid; 2) TLTs are less reliable; 3) TLTs are less inclusive; and 4) TLTs are less equitable. In addition to presenting these arguments against TLTs, the authors provide a set of practice-based recommendations for faculty in higher education on how to avoid TLTs in their courses.

Gernsbacher, M. A., Soicher, R. N., & Becker-Blease, K. A. (2020). Translational Issues in Psychological Science6(2), 175

[link to article]

Out of Place: Socioeconomic Status, Use of Public Space, and Belonging in Higher Education

Across four studies, the authors examine the relationship between socioeconomic status (SES), use of public spaces in higher education and feelings of belongingness at elite institutions. Consistent with prior research on SES and the use of public space, the authors found that lower-SES students use public spaces on campus less than their higher-SES peers (see supplementary analyses for analyses by race instead of SES). Analyses also showed that the use of those public spaces (especially iconic public spaces) mediates the relationship between SES and feelings of belonging (i.e., lower SES students tend to use the space less, which, in turn, negatively affects their feelings of belonging). Finally, when the use of public space was experimentally manipulated, results showed that the increased use of space can reduce and even eliminate the SES gaps in felt belongingness. Altogether, this work highlights the importance of creating welcoming and inclusive spaces on college campuses and should warrant a closer look at the signals that such spaces are sending to students. 

Trawalter, S., Hoffman, K., & Palmer, L. Journal of personality and social psychology. Advance online publication.

[link to article]

On Students’(Mis) judgments of Learning and Teaching Effectiveness

This is a review of the research on students’ judgement of their learning in higher education and their role in evaluations of teaching effectiveness. The authors summarize research from laboratory studies as well as classroom data that help us understand the factors that contribute to students’ perceptions of their learning and their underlying mechanisms. These factors include the general tendency for overconfidence, perceptions of organization and clarity, and instructional fluency. The authors argue that the ability to accurately evaluate one’s own learning is more important now than ever before, and subjective impressions of learning that are often misused as evaluations of teaching effectiveness represent a barrier to the development of those metacognitive skills.

Carpenter, S. K., Witherby, A. E., & Tauber, S. K. (2020). Journal of Applied Research in Memory and Cognition.

[link to article]

The Tyranny of Content:“Content Coverage” as a Barrier to Evidence-Based Teaching Approaches and Ways to Overcome It

This paper addresses the longstanding, instructor-centered model of “content coverage” that often incentivizes instructors to spend more time “delivering” content in their courses, often at the expense of deeper, more meaningful learning experiences in the classroom. The authors unpack this model from an historical perspective and offer analysis through the lens of what modern learning science has taught us about how students learn. In addition, they propose a three-step process to help instructors move away from the “tyranny of content coverage” and focus on a more learner-centered approach that can help students achieve deeper and longer-lasting learning.

Petersen, C. I., Baepler, P., Beitz, A., Ching, P., Gorman, K. S., Neudauer, C. L., ... & Wingert, D. (2020). CBE—Life Sciences Education19(2), ar17.

[link to article]

No digest this month

Active learning narrows achievement gaps for underrepresented students in undergraduate science, technology, engineering, and math

The authors conducted a meta-analysis using data from both published and unpublished studies to examine the effects of active learning on achievement gaps and passing rates in STEM fields for underrepresented students (URS). The data the authors used came from a wide array of STEM disciplines, courses, and instructors and compared student outcomes from a variety of active learning interventions to those coming from traditional lecture formats. Overall, the analyses revealed a 33% reduction in the achievement gap between URS and non-URS, and a 45% reduction in the gap between their respective probability of passing the course. The authors also found extensive variation in these changes among the studies included in the analysis, revealing “active learning intensity” to be a significant moderator for both achievement gaps and passing rates. That is, achievement gap and passing rate reductions occurred more robustly in courses where a higher percentage of class time was spent engaged in active learning activities. The authors posit that, in general, it is likely the synergy between two key elements that ultimately leads to success in reducing these gaps: 1) employing deliberate, engaging practice with important material, and 2) fostering a culture of inclusion. This specific theory has not undergone rigorous testing, however, and will hopefully be a high priority for future research.

Theobald, E. J., Hill, M. J., Tran, E., Agrawal, S., Arroyo, E. N., Behling, S., ... & Grummer, J. A. (2020). Proceedings of the National Academy of Sciences117(12), 6476-6483.

[link to article]

[supplementary appendix]

Does the Interleaving Effect Extend to Unrelated Concepts? Learners’ Beliefs Versus Empirical Evidence

In three experiments, the authors examined the effects of interleaving learning materials at multiple levels, such as when a student must study multiple concepts embedded in unrelated domains (e.g., a physics course and a psychology course each with multiple concepts to be learned). In this type of scenario, which is common for most college students, decisions need to be made regarding the optimal studying strategy – should the student interleave study materials, and if so, should the interleaving occur at the concept level, domain level, or both? Results suggest that the optimal sequence involves interleaving at either the domain or concept level, but not both. This finding can be explained by existing theories of why interleaving is generally more effective than blocking. Furthermore, the authors found that, when given a choice, students rarely employed the optimal strategy, whether they were tasked with scheduling their studying on a single level (e.g., multiple concepts from a single domain only) or two levels (e.g., multiple concepts from multiple domains). 

Yan, V. X., & Sana, F. (2020, March 12). Journal of Educational Psychology. Advance online publication. 

[link to article]

How Firm Are the Foundations of Mind-Set Theory? The Claims Appear Stronger Than the Evidence

One's mind-set is described as having profound effects on one's approach to life, including one's motivation, learning, and approach to challenges. This study examines the evidentiary strength of six key premises of mind-set theory in 438 participants: (1) people with growth mind-sets hold learning goals, (2) people with fixed mind-sets hold performance goals, (3) people with fixed mind-sets hold performance-avoidance goals, (4) people with fixed mind-sets believe that talent alone - without effort - creates success, (5) people with growth mind-sets persist to overcome challenge, and (6) people with growth mind-sets are more resilient following failure. This study finds that, in all cases, mind-set's effects were significantly weaker than the average effect size found in social-psychological research, and that only 2 of the 6 premises (#1 and 2) were statistically significant in the predicted direction. Given these findings, the authors suggest that mind-set researchers temper strongly worded claims regarding the importance of mind-set.

Burgoyne, A. P., Hambrick, D. Z., & Macnamara, B. N. (2020). Psychological Science

[link to article]

Knowledge or Abilities? How Undergraduates Define Intelligence

Literature on mindset theory, or "implicit theories of intelligence" is divided in terms of showing its power in predicting academic outcomes, with recent meta-analyses suggesting that there is little to no correlation between a student's mindset and their learning outcomes. Often, mindset is measured by student self-reports using validated instruments about their beliefs. However, these authors suggest that because mindset instruments often fail to define what they mean by "intelligence," they lack process validity when used with undergraduates. In this study, students were asked to more explicitly define their views on intelligence through surveys (n = 100) or interviews (n = 20), which were compared to how they responded to items on common mindset scales. Students generally viewed intelligence in terms of either knowledge or abilities, with some viewing it as both or neither. Students who viewed intelligence in terms of knowledge adopted more of a growth mindset, while those who viewed it as ability adopted more of a fixed mindset. This study suggests that when asking students about their beliefs on intelligence, researchers may need to be more specific, and that past research using mindset scales may need to be viewed with a more critical eye.

Limeri, L. B., Choe, J., Harper, H. G., Martin, H. R., Benton, A., & Dolan, E. L. (2020). CBE—Life Sciences Education19(1), ar5.

[link to article]

Think, pair, freeze: The association between social anxiety and student discomfort in the active learning environment

Researchers investigated the role of social anxiety in college students when it comes to benefitting from active learning. Across three studies, (N=569), the authors found that many students met the clinical threshold for social anxiety, and that that social anxiety was positively associated with reported discomfort with active learning. These two variables interacted to predict final course grades in courses that were structured with a variety of active learning strategies. For students with high active learning discomfort, social anxiety negatively predicted course grades, whereas when students reported low active learning discomfort, social anxiety was not related to student performance. These results suggest that for students who are high in both social anxiety and active learning discomfort, active learning may not provide all of its expected learning benefits.

Cohen, M., Buzinski, S. G., Armstrong-Carter, E., Clark, J., Buck, B., & Reuman, L. (2019). Scholarship of Teaching and Learning in Psychology, 5(4), 265–277
[link to article]

An inclusive pedagogy in Arts and Humanities university classrooms: What faculty members do

Researchers interviewed N=24 faculty in the field of Arts and Humanities that had been identified by students with disabilities as being open and supportive to them in classes. The three main takeaways from the qualitative analysis of the interviews are that instructors that are seen as supportive by students with disabilities do: 1. Plan their class and share their planning with students (and listen to their opinions), they get to know their students early on. 2. they use a variety of teaching methods within active learning, and 3. they apply changes to the whole class and assume the diversity of their students. 

Carballo, R., Cotán, A., & Spinola-Elias, Y. (2019). An inclusive pedagogy in Arts and Humanities university classrooms: What faculty members do. Arts and Humanities in Higher Education,0(0), 1-21 DOI:10.1177/1474022219884281
[link to article]

Rethinking the use of tests: A meta-analysis of practice testing.

The "testing effect", or gains in learning that are a result of retrieval practice, is a well documented phenomenon that has been studied under many different conditions. This paper features a meta-analysis of the` research that has been done comparing the testing effect to other "non-testing" conditions (e.g., "restudying"), which included 118 different articles and 272 different effect sizes. The results of the meta-analysis show that practice testing is, indeed, superior to all other non-testing learning conditions. In addition, moderator analyses highlight important features of testing effect studies that have had a significant impact on the overall findings (e.g., test format, time interval, availability of feedback, etc.). These results can be helpful for any teacher, student, or researcher who is interested in leveraging the testing effect to be as impactful as possible.

Adesope, O. O., Trevisan, D. A., & Sundararajan, N. (2017). Review of Educational Research87(3), 659-701.
[link to article]

Unpacking “active learning”: A combination of flipped classroom and collaboration support is more effective but collaboration support alone is not

“Active learning” comprises a relatively heterogeneous set of strategies that often get lumped together. This “2nd generation” active learning study aimed to further differentiate which active learning strategies are most effective and investigate beyond the simple hypothesis that “active learning is more effective than traditional lecture”. In a quasi-experiment, the researchers compared the effect of using collaborative activities, and a combination of both collaborative activities and a flipped classroom, to traditional lecture format. Findings suggest that the combination of the flipped classroom and collaborative activities is most effective, and that collaborative activities alone may not always offer an advantage over traditional lecture.
Rau, M. A., Kennedy, K., Oxtoby, L., Bollom, M., & Moore, J. W. (2017). Journal of Chemical Education94(10), 1406-1414.
[link to article]

Gender similarities in the brain during mathematics development

The difference between men and women in their pursuit of careers in STEM fields has long been hypothesized to have biological underpinnings, particularly with regard to aptitude in mathematics. The present research tested this hypothesis using functional magnetic resonance imaging (fMRI) to take real-time images of participants’ brain activity while viewing mathematics educational videos. This was done in three studies with a total of 104 typically-developing 3-to 10-year-old children.

Overall, the results were consistent with prior work on the neural correlates of mathematical thinking; participants engaged in the predicted mathematical neural processes during the viewing tasks. In addition, the results failed to show evidence for any differences in these processes between male and female participants. Comparisons of neural maturity between male and female participants also yielded no evidence of differences based on reported gender, suggesting that the neural processing of mathematics develops at similar rates in boys and girls. Lastly, to the extent that variability in neural processing was observed, analyses suggest that the participants’ patterns of neural activity reflect one large heterogeneous group, rather than two distinct groups. Taken altogether, the results show widespread gender similarities in neural development and processing of mathematical content, suggesting the differences in STEM performance observed later in life are unlikely to originate from early childhood differences in cognition.

Kersey, A. J., Csumitta, K. D., & Cantlon, J. F. (2019). npj Science of Learning4(1), 1-7.
[link to article]

Using Relevant Animations to Counter Stereotype Threat When Learning Science

This research extends work on the roles of stereotype threat and multimedia animations in student learning by testing whether the presence of relevant multimedia imagery can mitigate the negative effects of stereotype threat while learning. Participants in this lab study were 128 college students randomly assigned to one of four conditions in a 2x2 design that manipulated the presence of stereotype threat and multimedia animations that were relevant but redundant with the material. Participants were assigned to either receive a threat or not, and to subsequently read a science-based text that either contained animations or did not. After completing the assigned reading, all participants were tested for learning transfer using an essay format and rated their own effort on a 1-10 scale. Results showed a significant interaction between animation and threat condition on both test performance and reported effort, revealing a buffering effect of animations after receiving a threat. In the threat condition, participants who received animations scored significantly higher on the transfer test and reported expending more effort relative to participants who did not receive animations. These results suggest that the use of relevant animations could be helpful for individuals at risk for stereotype threat in STEM fields.

Sanchez, C. A., & Weber, K. (2019).  Journal of Applied Research in Memory and Cognition8(4), 463-470.
[link to article]

Does interleaved practice enhance foreign language learning? The effects of training schedule on Spanish verb conjugation skills.

Four lab experiments evaluated the benefits of interleaving in the domain of foreign language learning (Spanish). Two different verb tenses were learned using either blocking or interleaving, followed by a delayed test on the content. In two experiments, the learning took place during a single session, and the researchers did not observe learning benefits in the interleaving condition. In two other experiments, however, the learning was increased to two sessions and spread across two weeks, and the results showed the expected learning benefits of interleaving. In addition to providing a novel extension of the interleaving effect to foreign language learning, these results suggest that interleaving may be most beneficial when used across multiple training sessions.

Pan, S. C., Tajran, J., Lovelett, J., Osuna, J., & Rickard, T. C. (2019).  Journal of Educational Psychology, 111(7), 1172-1188.
[link to article]


Instructor presence in video lectures: The role of dynamic drawings, eye contact, and instructor visibility

Two lab experiments investigated the effects of different “instructor presence”features (eye contact, dynamic drawings, and instructor visibility) when learning from video lectures. The first experiment tested whether students learned better from a recorded lecture played over a series of static drawings, or the same lecture but the drawings were dynamically drawn throughout the lesson. No instructor was visibly present in either of these conditions. Results showed that the dynamic drawing condition performed significantly better on the posttest. The second experiment used the same lesson, but with the instructor now visible. In one condition, the instructor made eye contact with the user while drawing on a transparent whiteboard, and in the other condition the instructor did not make eye contact and completed the drawings on a regular whiteboard. As predicted, results showed significantly better learning in the eye contact group relative to the no eye contact group. In addition, the dynamic drawing group from experiment 1 and the eye contact group from experiment 2 were compared and no significant difference in posttest performance was found. These results show that there are additional features to consider beyond merely having an instructor present on the screen that can enhance learning from videos.

Fiorella, L., Stull, A. T., Kuhlmann, S., & Mayer, R. E. (2019). Journal of Educational Psychology111(7), 1162-1171.
[link to article]

Measuring actual learning versus feeling of learning in response to being actively engaged in the classroom

Students in a large introductory physics course (N = 159) were taught identical content by either 1) active instruction or 2) passive instruction. Students' self-reported feelings about their learning were compared to their actual learning in the course, as measured by exam scores. Students in the active instruction sections performed significantly better than those in the passive instruction group, but reported lower "feelings of learning" (FOL). This study nicely addresses student resistance to active learning techniques, and discusses ways to address this resistance directly with students, particularly by acknowledging the discomfort students often feel with active learning and framing it as a "desirable difficulty."

Deslauriers, L., McCarty, L. S., Miller, K., Callaghan, K., & Kestin, G. (2019). Proceedings of the National Academy of Sciences116(39), 19251-19257.
[link to article]

Seductive Details in the Flipped Classroom: The Impact of Interesting but Educationally Irrelevant Information on Student Learning and Motivation

Students in a flipped classroom (N = 754) were randomly assigned to either a control group who saw traditional, fact-based videos outside of class for prework and a treatment group who viewed the same videos with seductive details added. The same course instructor presented the information, and everything in class was the same for both groups. The groups did not score differently on quizzes of the material, but the students in the treatment group with high self-reported levels of prior knowledge viewed the videos favorably and believed they were learning more from them than those who did not see the seductive details. This study contradicts other previous observations that seductive details hinder learning, and although it doesn't show that they harm students, they also do not help. If anything students (especially those who highly estimate their skills) may actually overestimate their learning when presented with seductive details.

Maloy, J., Fries, L., Laski, F., & Ramirez, G. (2019). CBE—Life Sciences Education18(3), ar42.
[link to article]

Smaller Classes Promote Equitable Student Participation in STEM

Previous studies identify six course elements that are shown to impact equitable gender participation in STEM courses, including student-instructor interactions, active learning, the instructor’s gender, gender-balanced classrooms, class size, and the type of course (lower vs. upper division). The present research examined which element best supports female student participation in those courses. The authors collected student behavioral data from 44 courses across six American universities. Results indicate that increasing class size has the greatest negative effect on women’s participation in the classroom, and active learning leads to increased, voluntary participation of women.

Ballen, C. J., Aguillon, S. M., Awwad, A., Bjune, A. E., Challou, D., Drake, A. G., ... & Harcombe, W. (2019). BioScience69(8), 669-680.
[link to article]

Can Test Anxiety Interventions Alleviate a Gender Gap in an Undergraduate STEM Course?

Undergraduate students in a large (N = 779) introductory biology course were assigned quasi-randomly into control or treatment groups to study the effects of reappraisal and expressive writing interventions on test anxiety. Reappraisal involved students learning to recognize physiological anxiety responses and their effects on cognitive and physical performance, and expressive writing involved a short writing test prior to taking an exam. The study found that 1) women in the course self-reported higher levels of test anxiety before and after exams compared to men, 2) higher self-reported test anxiety predicted worse exam performance (but better performance on other course assignments), 3) the interventions did not affect self-reported levels of test anxiety, and 4) the interventions resulted in higher exam scores for all participants, regardless of gender.

Harris, R. B., Grunspan, D. Z., Pelch, M. A., Fernandes, G., Ramirez, G., & Freeman, S. (2019). CBE—Life Sciences Education18(3), ar35.
[link to article]

Exploring sequences of learner activities in relation to self-regulated learning in a massive open online course

Researchers tested whether interventions aimed at encouraging Self-Regulated Learning (SRL) in a Massive Open Online Course (MOOC) impacted students’ performance and retention. N=655 participants took the MOOC and N=222 were in the treatment condition where they viewed SRL video prompts every week. Researchers found a significant difference between the intervention group and the control group with participants who viewed the SRL videos having interacted with more course activities and followed the course structure more closely.

Wong, J., Khalil, M., Baars, M., de Koning, B. B., & Paas, F. (2019). Computers & Education140.
[link to article]


What changes, and for whom? A study of the impact of learning analytics-based process feedback in a large course

Researchers observed the differences in self-regulated learning behaviors of (N=784) undergraduate students in a first-year biology class. The experimental group received learning analytics based feedback messages in weeks 4 and 8 of the semester while the control group did not receive any such feedback. The feedback reminded students how they did on the previous quiz as well as a reminder that using the online textbooks was crucial for success in the course. Looking at the online metrics, researchers concluded that the treatment group interacted more frequently with the online tools of the class after the intervention and performed better in their final grades than the control group. There was no difference in the impact of this feedback for students based on varying background characteristics.

Lim, L. A., Gentili, S., Pardo, A., Kovanović, V., Whitelock-Wainwright, A., Gašević, D., & Dawson, S. (2019). Learning and Instruction.
[link to article]

Defining and Measuring Engagement and Learning in Science: Conceptual, Theoretical, Methodological, and Analytical Issues

It has been argued that engagement is a construct that is widely overgeneralized and often misused in the learning science literature. This paper reviews the key issues pertaining to the defining and measuring of student engagement and presents the pros and cons of various approaches featured in several related articles. The author highlights important challenges and questions for future research and offers an optimistic perspective on the potential for further progress in this area.

Azevedo, R. (2015). Educational Psychologist50(1), 84-94.
[link to article]


The ICAP Framework: Linking Cognitive Engagement to Active Learning Outcomes

This paper describes a framework (ICAP) of four different modes of student engagement that are hypothesized to be associated with student learning. The four modes, passive, active, constructive, and interactive, represent progressively increasing levels of engagement that are thought to correspond to progressively increasing levels of learning. The authors outline the underlying assumptions and existing evidence for the ICAP framework, and propose processes for the associated changes in learning. By clearly operationalizing the construct of engagement and providing hypotheses regarding its association with learning, the ICAP framework represents a theoretically promising and widely applicable model for collecting meaningful data on student engagement.

Chi, M. T., & Wylie, R. (2014). Educational psychologist49(4), 219-243.
[link to article]

How the Design of Presentation Slides Affects Audience Comprehension: A Case for the Assertion-evidence Approach

The assertion-evidence structure is a framework for constructing educational slides that aims to integrate six multimedia learning principles for more effective learning. In this study, 110 engineering students viewed technical presentations of slides that were constructed either according to the assertion-evidence structure or with what the authors refer to as the ‘default-driven’ practice, which does not explicitly align with the aforementioned multimedia learning principles. Upon evaluating student learning outcomes, it was found that students showed better comprehension with fewer misconceptions when learning from the assertion-evidence slides compared to the default-driven slides. Student performance showed the same pattern on an unexpected delayed posttest administered one week later. Interestingly, the students rated their perceived mental effort while learning from the slides as significantly less when learning from the assertion-evidence slides relative to the default-driven slides.

Garner, J., & Alley, M. (2013). International Journal of Engineering Education29(6), 1564-1579.
[link to article]


Slide Structure Can Influence the Presenter’s Understanding of the Presentation’s Content

Research has shown that students learn more and have fewer misconceptions when they view educational slides constructed with the assertion-evidence structure compared to when slides are constructed with alternative strategies. In this study, 120 engineering students were asked to create their own slides that could be used to teach other students a lesson, with approximately half of them being assigned to utilize the assertion-evidence structure and half of them being assigned to create their slides with a structure of their choosing. Shortly after completion of this assignment, students were given an unannounced comprehension test on the content of the lesson for which they were designing slides. The authors found that the students who designed their slides using the assertion-evidence structure performed significantly better on the comprehension test than students who were assigned to create slides with a structure of their choosing. These results offer further evidence for the effectiveness of the assertion-evidence structure when presenting educational information.

Garner, J. K., Alley, M., & Aippersbach, S. (2016). International Journal of Engineering Education32(1), 39-54.
[link to article]

Transfer of test-enhanced learning: Meta-analytic review and synthesis

This paper features a comprehensive meta-analysis of the research on how test-enhanced learning (i.e., the "testing effect") promotes learning transfer, or learning that allows students to generalize their knowledge and successfully apply it in different situations. In analyzing data collected over the past 40 years, including 192 effect sizes from 67 papers, the authors found strong evidence for test-enhanced learning yielding transferable learning benefits when compared to non-testing conditions such as restudying or rereading (d = .40). The authors propose a framework for understanding the transfer of test-enhanced learning based on three significant moderators in their analyses: A) response congruency, B) elaborated retrieval practice, and C) initial test performance. According to this framework, transfer is most likely when the answers on the initial test and transfer test are the same (A), when the initial test and transfer test involve a broader level of encoding (e.g., addressing multiple levels of knowledge as described in Bloom's Taxonomy) (B), and when performance on the initial test is high (C). Potential implications as well as directions for future research in this area are discussed.

Pan, S. C., & Rickard, T. C. (2018). Psychological bulletin144 (7), 710.
[link to article]

Equivalent but not the Same: Teaching and Learning in Full Semester and Condensed Summer Courses

Are there differences in student learning outcomes between full and condensed courses? The literature presents mixed findings, which the authors attribute to key differences across study designs (course lengths, course logistics, and measurement tools). To provide clarity, the authors present a mixed methods study design comparing 14-week full semester courses to 6-week summer courses between Summer 2015 and Fall 2016. The study leverages pre/post tests and final grades to measure student performance, a survey design to assess student perceptions, and a focus group to assess faculty perceptions. Findings suggest that there is no difference in student learning between course formats (for pre/post measure), students perceive condensed courses as less stressful and prefer it to full-semester courses, and faculty also perceive condensed courses as less stressful and more beneficial to student learning.

Walsh, K. P., Sanders, M., & Gadgil, S. (2019). College Teaching, 67 (2): 138-149
[link to article]

Comparison of student team dynamics between nonflipped and flipped versions of a large‐enrollment sophomore design engineering course

An undergraduate engineering design course (N=167) using team-based learning was used to study differences across team conflict, peer assessment, and team member satisfaction in flipped (Fall 2015) versus non-flipped (Fall 2014) versions of the course. Self-reported survey data were used to collect student responses on satisfaction and three categories of team conflict: task conflict, relationship conflict, and process conflict. Web-based CATME was used to collect student responses on peer assessment. Findings suggest that flipped courses produce greater student satisfaction and more positive peer assessments than non-flipped courses.

Baughman, J., Hassall, L., & Xu, X. (2019). Journal of Engineering Education108(1), 103-118.
[link to article]

Agile research studios: Orchestrating communities of practice to advance research training

Researchers from the Design, Technology, and Research team at Northwestern University reported on their use of Agile Research Studios (ARS). This model provides an opportunity for faculty to work with large teams of students and researchers effectively and in a way that contributes meaningfully to undergraduate professional development. Students regularly meet in small and then progressively larger groups in between full studio meetings, and are given virtual tools to connect and share resources with each other. Students reported that the experience had a positive impact on their planning and research skills, and increased willingness in seeking and providing help along the way.

Zhang, H., Easterday, M. W., Gerber, E. M., Rees Lewis, D., & Maliakal, L. (2017, February). In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (pp. 220-232). ACM.
[link to article]

STEM Faculty Who Believe Ability is Fixed Have Larger Racial Achievement Gaps and Inspire Less Student Motivation in Their Classes

STEM faculty at one university were surveyed (N=150) and completed a two-item mindset scale measuring perceptions of a growth vs. fixed mindset for their students (e.g., "students have a certain amount of intelligence and can't do much to change it"). Course grades for over 15,000 students were analyzed to examine whether there was a relationship between faculty mindset toward their students and course performance. Overall, a significant relationship was found, with students performing worse, on average, in courses taught by faculty reporting relatively low levels of growth (i.e., fixed) mindset. Underrepresented minority students (URM) showed especially low performance for low-growth mindset faculty, which exacerbated the overall STEM achievement gap for URM students.  In addition, student reports of motivation were lower in courses taught by faculty with relatively low growth mindsets towards their students.

Canning, E. A., Muenks, K., Green, D. J., & Murphy, M. C. (2019). Science Advances5(2), eaau4734.

Retrieval practice & Bloom’s taxonomy: Do students need fact knowledge before higher order learning?

Prior work argues that students need to achieve basic, lower level learning outcomes (e.g., factual knowledge) before moving on to pursue higher order learning outcomes (e.g., application and synthesis) successfully. In two laboratory experiments, the present research evaluates whether building a foundation of factual knowledge enhances students higher order learning. Results show that retrieval practice with lower level learning outcomes did not benefit higher order learning, and that higher order learning was best when students were given the opportunity to practice using higher order quizzes. These results suggest that in order for students to best achieve higher order learning outcomes, establishing a strong lower level foundation is not beneficial, and it may be best to spend more time practicing higher order skills instead. The authors discuss implications and theoretical rationale for their findings, which were also replicated in an authentic K-12 classroom setting. 

Agarwal, P. K. (2019).  Journal of Educational Psychology, 111(2), 189-209.
[link to article]

Knowing is half the battle: Assessments of both student perception and performance are necessary to successfully evaluate curricular transformation

Student perceptions of active, inquiry-based pedagogical approaches in introductory biology courses were measured and compared to their learning gains in the course. Over a four year time period, the 542 students' responses indicated that their perceptions of the instructional approach became more positive over time, as did their learning gains measured by a pre- and post- course concept test. The authors argue that negative perceptions among students, which often accompany curricular changes, may decrease over time as the new practices gain traction and students develop more buy-in. However, tailored instruments designed to probe student attitude and motivation are more informative in measuring this compared to end-of-semester evaluations.

Shaw, T. J., Yang, S., Nash, T. R., Pigg, R. M., & Grim, J. M. (2019). PloS one14(1), e0210030

Investigating the Replicability and Generalizability of the Negative Testing Effect

Some recent research has shown that retrieval practice, known as ‘the testing effect’, can actually be disruptive to learning when it is utilized under specific conditions. Such findings suggest that there are conditions under which taking quizzes or tests is not only not helpful for learning, but actually detracts from it – a so-called ‘negative testing effect’. One limitation of many cognition experiments, however, is a potential lack of generalizability due to limited authenticity of the learning materials that are used in laboratory settings. One goal of the present work was to adapt the design of the aforementioned research in an attempt to replicate the ‘negative testing effect’ using more educationally relevant materials. In multiple experiments, their results show that trials using the educationally relevant learning materials failed to replicate a negative testing effect, which suggests that such an effect may be driven by the lack of educational relevance of the materials in question.

Wissman, K. T., & Peterson, D. J. (2018). Journal of Applied Research in Memory and Cognition (7)3, 352-360.
[link to article]

An adaptive collaboration script for learning with multiple visual representations in chemistry

Researchers assessed whether an adaptive collaboration script (a software providing real-time feedback to student groups) helped students learn visual representations of chemistry better than a traditional paper worksheet setting with delayed feedback (of one week). The research question was tested in a quasi-experiment with 61 undergraduate students involved in an introductory chemistry course. Students in the adaptive collaboration script condition showed significantly higher learning gains on a transfer test immediately after the intervention and with complex concepts on a midterm exam three weeks later.

Rau, M. A., Bowman, H. E., & Moore, J. W. (2017). Computers & Education109, 38-55.

Measurement of cognitive load in multimedia learning: a comparison of different objective measures

Using multiple objective measures of cognitive load, these researchers provide evidence for the seductive details hypothesis by demonstrating that students completing a computer-based multimedia learning task that featured extraneous information (i.e., seductive details) exhibited higher levels of cognitive load as well as a decrease in retention and comprehension (relative to a no-extraneous information condition), despite self-reports to the contrary. These results are novel as few studies of this type feature direct measurements of cognitive load in this context.

Korbach, A., Brünken, R., & Park, B. (2017). Instructional science45(4), 515-536.
[link to article]

Can I get better? Exploring mindset theory in the introductory communication course

In this study, researchers adapt a mindset scale to examine the role of a growth mindset in an introductory communication (i.e. public speaking) course, asking whether having a growth mindset was correlated with public speaking anxiety (PSA), interpersonal communication competence, student engagement, and student performance. They were also particularly interested in whether a growth mindset could help make predictions related to any of these factors. 1037 participants taking one of two, required introductory communication course completed survey instruments at the end of the semester and individual speech grades were also analyzed. Results indicated a significant negative correlation between growth mindset and PSA and significant positive correlations were found for mindset and student engagement, performance, and communication competence. Researchers suggest that next steps include research into possible interventions.

Nordin, K., & Broeckelman-Post, M. A. (2019). Communication Education, 68(1), 44-60

Do Students Overestimate Their Contribution to Class? Congruence of Student and Professor Ratings of Class Participation

Research suggests that students' perceptions of their class particiation are not always congruent with professors' perceptions. The authors conducted two studies to examine (1) the extent to which students' and professors' perceptions are misaligned and (2) whether mid-term feedback would increase congruence. In Study 1, students and professors across nine courses (N = 191) used a rubric to assess student participation. In Study 2, students (N = 87) were non-randomly selected into a treatment group that received mid-term feedback (using the same rubric from Study 1) on their participation and a control group that did not receive feedback. Students and professors in both groups then used the rubric again to evaluate student participation at the end of term. Findings show that student participation is generally correlated with professors' perceptions, but that the largest perception gap occurs for low student participators. Additionally, mid-term feedback was not shown to increase congruence between student and professor ratings of participation. 

Meyer, M. L., McDonald, S. A., DellaPietra, L., Wiechnik, M., & Dasch-Yee, K. B. (2018). Journal of the Scholarship of Teaching and Learning18(3), 44-54.
[link to article]

Dividing attention in the classroom reduces exam performance

118 students were randomly-assigned students in two identical course sections, and were either allowed to use mobile devices during certain (controlled) class periods or not. They completed paired questions in class and later on exams to measure both the short term and long term impacts of device distraction. Although it had no effect on their immediate recall of information (based on in-class questions), students in the no-device sessions retained significantly more information than students in the device-allowed sessions, regardless of whether devices were chosen to be used in those sessions or not.  
Glass, A. L., & Kang, M. (2018). Educational Psychology, 1-14.

Two-stage examinations: Can examinations be more formative experiences?

This paper examines the effect of two-stage examinations, which are exams that feature both an individual and collaborative component, on student performance. Two-stage examinations were administered 11 times to five successive cohorts of students (N = 899) in a variety of courses for both midterm and final examinations between 2013 and 2017. Researchers compared the group's individual average scores to the group score. Researchers used these scores to identify individual-to-group gains in performance and individual-to-top student gains in performance.  Overall, the authors found that two-stage exams offered substantial performance gains for individuals when working in the group stage, and that students perceived two-stage exams as more helpful and less stressful than traditional exams. 

Levy, D., Svoronos, T., & Klinger, M. (2018). Active Learning in Higher Education, 1469787418801668.
[link to article]

The lure of seductive details during lecture learning

The negative impact of seductive details on learning is well documented in the lab. Although there are numerous studies that focus on text passages or narrated multimedia modules in demonstrating those effects, there is a dearth of research on these effects occurring in lectures or other settings that represent high stakes learning environments. The current research (N=259) examined the impact of seductive details across both low stakes (completed the study for research participation credit) and high stakes (completed the study under conditions of social, evaluative, and performance based pressure) learning contexts. Results showed that seductive details were detrimental to learning in the low stakes, but not the high stakes, learning environment. In addition, students who tested high for prior knowledge on the subject matter were not impacted by seductive details in either condition. These results suggest that the impact of seductive details on learning may be more dependent on context than previously thought.

Fries, L., DeCaro, M. S., & Ramirez, G. (2018). Journal of Educational Psychology. Advance online publication.
[link to article]

Using Selective Redundancy to Eliminate the Seductive Details Effect

Although there is much evidence that suggests the inclusion of seductive details in the presentation of a lesson impairs learning, there is also work to suggest that the interest/engagement that results from “hooking” a student’s attention can be beneficial. In this research, the authors attempted to mitigate the negative effects of seductive details by fostering shallower processing of those details, while at the same time fostering a deeper processing of essential information.  In an online experiment, participants (N=69) were presented a lesson in one of three conditions: one with seductive details presented with spoken audio paired with redundant on-screen text, one with seductive details presented without the redundant text, and one with neither seductive details nor redundant text. Results showed that when presented seductive details paired with redundant text, participants did not suffer the same learning decrement experienced when seductive details were presented without redundant text. Although learning in this critical condition was not significantly different from the condition without any seductive details, these findings suggest that by inducing shallower processing through the use of the redundancy principle, it is possible to avoid the negative effects of seductive details on learning.

Yue, C. L., & Bjork, E. L. (2017). Applied Cognitive Psychology31(5), 565-571.
[link to article]

It’s all a matter of perspective: Viewing first-person video modeling examples promotes learning of an assembly task.

This paper examines the effects that different ways of creating videos from an instructional design perspective can have on learning. In one experiment, 105 participants were randomly assigned to watch an instructional video that was filmed either with a first-person perspective or a third-person perspective, with the content being otherwise identical in both videos. It was found that participants who viewed the instructional video from a first-person perspective were able to perform the task from the video better than students who viewed the same video from a third-person perspective. This effect was shown to be even stronger for more complex tasks. In a second experiment, this effect was replicated in a different lab with 120 participants. These findings suggest an instructional design principle in which people learn better from videos constructed from a first-person perspective relative to a third-person perspective.

Fiorella, L., van Gog, T., Hoogerheide, V., & Mayer, R. E. (2017). Journal of Educational Psychology, 109(5), 653.
[link to article]

Faculty drivers and barriers: Laying the groundwork for undergraduate STEM education reform in academic departments.

Researchers sought to describe the response of faculty to efforts of shifting norms in teaching toward evidence-based and pedagogically informed practices. Analysis of responses resulted in ranked lists of issues categorized as barriers (18) or drivers (15). The distribution and frequency of faculty responses to efforts to shift teaching practices provides a useful framework for strategies that may be employed to effect change. The results and discussion offer valuable context for potential dialogue with faculty and may help to anticipate and preemptively address concerns and/or emphasize positive aspects that faculty view as driving forces that can be used to motivate change.

Shadle, S.E., Marker, A., & Earl, B. (2017). International Journal of STEM Education, 4:8, p. 1-13.
[link to article]

Should students assessed as needing remedial mathematics take college-level quantitative courses instead? A randomized controlled trial.

Students needing to take remedial math classes often do not pass those classes and have high levels of college dropout. Consequently, some colleges have started to allow students to take college level classes without first taking remedial courses. The researchers randomly assigned students (n=717) in need of remedial classes to take either a traditional remedial algebra class, a remedial algebra class with workshops, or a college level statistics class with workshops. Students assigned to the college-level statistics class with workshops passed the class at a higher rate than students in remedial algebra with or without workshops (56% vs 39% and 45%). Students assigned to the college-level statistics class accumulated more college credits than those in the remedial class.

Logue, A. W., Watanabe-Rose, M., & Douglas, D. (2016). Educational Evaluation and Policy Analysis38(3), 578-598.
[link to article]

Examining the contributions of desirable difficulty and reminding to the spacing effect. 

Three experiments were conducted (N=134) to evaluate the desirable difficulties (DD) account of the mechanism underlying the benefits of spaced practice on learning. The DD account hypothesizes that retrieving information after a lag in time creates a slightly more difficult task that, in turn, leads to stronger encoding of the information.  Results from the three experiments, however, show that a longer lag time in between study events improves memory performance above and beyond the measured “desirable difficulty” induced by the lag itself, suggesting that the DD account of the spacing effect is either inaccurate or incomplete. That is, increasing the time lag between study events is effective, but this is not simply due to the increased difficulty of acquisition relative to that of a study event following a shorter (or zero) time lag.  The results of experiment 3 suggest that other variables, such as encoding variability, likely play a key role in explaining the spacing effect, although more research is clearly needed before coming to a firm conclusion.

Maddox, G. B., Pyc, M. A., Kauffman, Z. S., Gatewood, J. D., & Schonhoff, A. M. (2018). Memory & cognition, 1-13. , 1-19.
[link to article]

Brain drain: the mere presence of one’s own smartphone reduces available cognitive capacity

Undergraduate students in a laboratory setting were randomly divided into three conditions: those whose phones (turned off) remained 1) in a separate room outside the testing location, 2) in their bags near them, but out of sight, and 3) nearby and in sight. All students then completed a measure of working memory capacity and functional fluid intelligence. Students whose phones were most salient (condition 3) showed the lowest available cognitive capacity, while those whose phones remained in another room (condition 1) displayed the highest. All students self-reported that they did not believe the presence of their phone affected their performance. In a follow-up experiment, similar results held true whether the phones were on or off.

Ward, A. F., Duke, K., Gneezy, A., & Bos, M. W. (2017). Journal of the Association for Consumer Research2(2), 140-154.
[link to article]

A study exploring the impact of lecture capture availability and lecture capture usage on student attendance and attainment

Lecture capture has become more common and in some cases may even be retrofitted into classrooms. Despite perceived benefits of lecture capture for students (e.g. option to revisit lecture content), previous research has reported mixed findings about whether they are truly beneficial to student learning. In this study, researchers examined 2 cohorts of students in an introductory course: before lecture capture was available (n=161) and after lecture capture was implemented (n=160). Findings suggest that lecture capture availability had a negative impact on student attendance, that lecture capture usage associated with attendance was “negligible," and that, overall, lecture capture is an insufficient replacement for attendance for the vast majority students. 

Edwards, M. R., & Clinton, M. E. (2018). Higher Education, 1-19.
[link to article]

Self-Regulated Learning of Principle-Based Concepts: Do Students Prefer Worked Examples, Faded Examples, or Problem Solving?

Some research has shown the benefit of using worked examples for learners before engaging in independent problem-solving. This article explores what self-regulated learners choose to use when learning a new skill (in this case, solving probability problems). In Experiment 1 (N=102), participants chose between a worked example and independent problem solving over a series of 12 trials. Overall, participants favored independent problem solving unless their past trial was incorrectly answered. In Experiment 2 (N=182) and 3 (N=136), participants had a third option: partially worked examples. Participants chose this option more frequently than the fully worked examples. Researchers concluded that, although most learners were more likely to choose some form of worked examples after incorrect answers. they are less likely to choose as their first practice worked examples, despite it being better for their learning. When partially worked examples are available, however, they are more frequently chosen than fully worked examples when participants have that option. 

Foster, N. L., K. A. Rawson, J. Dunlosky. 2018. Learning and Instruction, vol. 55, pp. 124-138.
[link to article]

The Negative Consequences of Threat: A Functional Magnetic Resonance Imaging Investigation of the Neural Mechanisms Underlying Women's Underperformance in Math.

Brain imaging experiments were performed using FMRI on 28 female undergraduate students in a laboratory setting. All participants were asked to perform math tasks, however some were told that "research has shown gender differences in math ability and performance", presenting a stereotype threat condition. FMRI scans revealed that the women who did not hear this statement used parts of their brain associated with mathematical learning, while the women who heard the message reinforcing gender stereotypes about math did not employ these parts of the brain. Instead, the parts that were activated were associated with social and emotional processing. This study provides a complementary perspective to other stereotype threat literature about women's math performance.

Krendl, A.C.; Richeson, J.A.; Kelley, W.M.; Heatherton, T.F. (2008). Psychological Science, 19(2). 168-175.
[link to article]

Anatomy of STEM teaching in North American Universities

A large study of over 2000 classes by more than 500 faculty across North America was conducted to characterize the current state of STEM teaching using the COPUS protocol. Despite the large body of evidence to support the benefits of active learning, investigators found that didactic lecture is still the most common instructional style (74.9 +- 27.8% of the total time observed). Smaller classes and those in rooms with flexible seating were more likely than large, fixed-seat lectures to use interactive or student-centered approaches, although didactic lecture was sill the predominant teaching method. The authors recommend that institutions revise tenure, promotion, and merit-recognition policies to support evidence-based teaching practices, and state that research-based guidelines to measure effective teaching need to continue to be funded and developed.

Stains, M., et al. (2018). Science359 (6383), 1468-1470.
[link to article]

Realistic Details in Visualizations Require Color Cues to Foster Retention

Previous research has shown that students retained less information from realistic representations of biological structures. Instead, simplified drawings have been promoted to enhance learning. Skulmowski and Rey conducted a study to test whether color coding a realistic representation of a fictional bone would enhance the learning of the bone’s structure. Participants (N= 108) were randomly assigned and tested on one of 4 representations of a fictional bone: a simplified bone representation with labeled names of structure, a simplified bone representation with labeled names of structure and color coding of different areas of the bone, a realistic bone representation with labeled names of structure, a realistic bone representation with labeled names of structure and color coding of different areas of the bone. The researchers found that the realistic rendering of the bone structure enhanced by color coding led to better retention of information while students’ retention scores lowered when color coding was used on the simplistic bone representation. The authors concluded that realistic visualizations require appropriate visual aids in order to be effective but can be more effective for retention than simplified drawings. 

Skulmowski, A. and G. Rey (2018). Computers & Education vol 122, pp. 23-31
[link to article]

A Bayesian network meta-analysis to synthesize the influence of contexts of scaffolding use on cognitive outcomes in STEM education

This meta-analysis looks at N=56 studies on the impact of computer-based scaffolding on student learning. The researchers looked at within subjects gains in pre-post analysis of learning. The reviewed studies span from K-12 to graduate level students. The researchers found that computer scaffolding showed strong effect across student populations particularly for college and graduate students and STEM disciplines. 

Belland, Brian R., Andrew E. Walker, and Nam Ju Kim (2017). SReview of Educational Research, vol. 87, no. 6, pp. 1042-1081.
[link to article]

Stereotype threat effects on learning from a cognitively demanding mathematics lesson

A study of predominantly African-American 5th grade students (N=135) examined the effects of stereotype threat on initial student learning and knowledge formation using a math lesson.  Students assigned to the “threat” condition were asked to give their race at the beginning of the lesson - led to believe the study was about how students ‘like them’ learn best - and students in the control condition were asked to record the date instead of their race.  Results showed that students in the threat condition retained less information, enjoyed the lesson less, and reported lower levels of motivation than students in the control condition.  This effect was especially pronounced for students with higher levels of baseline executive functioning.  These findings suggest that stereotype threat may play a key role in the initial development of achievement gaps in education, and that its effects impact students on a deeper level beyond just test-taking performance.

Lyons, E. M., Simms, N., Begolli, K. N., & Richland, L. E. (2017). Cognitive science
[link to article]

Changes in syllabus tone affect warmth (but not competence) ratings of both male and female instructors

This study aimed to show correlations between the "friendliness" of a syllabus and student perceptions of the instructor's approachability and competence by gender. 150 undergraduate students were given either "friendly" or " not friendly" syllabi from either a female, male, or gender-unspecified instructor. The results showed that students perceived the "friendly" syllabus instructors as "more approachable, more caring, and more motivating, but not any more or less competent than those receiving the not friendly syllabus," regardless of gender. The article also includes a detailed list of example phrases from both the friendly and unfriendly syllabi, providing examples that could be used when teaching instructors about syllabus tone.

Denton, A.W.; Veloso, J. (2017). Social Psychology of Education (20). 1-15.
[link to article]

Student learning with permissive and restrictive cell phone policies: A classroom experiment

Two sections of a class taught by the same instructor had either a restrictive cell phone policy or a permissive cell phone policy (N=31). Students in the restrictive section were told they could be removed from class for use of their cell phones, and students in the permissive section were allowed to use cell phones during class. Researchers found no significant difference in the students' learning but found a statistically significant difference in the ratings of the instructor. The restrictive section gave higher ratings to the instructor than the permissive section. This research shows that student attitudes toward the instructor may not be negatively affected by a restrictive cell phone policy. 

Lancaster, Alexander (2018). International Journal for the Scholarship of Teaching and Learning, vol. 12, no. 1
[link to article]

Humor in the classroom: The effects of integrated humor on student learning 

Some previous research has suggested that humor could positively affect student motivation and attention. In this lab-based study, researchers asked whether integrated humor used to teach course concepts would affect students’ recall. In Study 1, 87 students were divided into two conditions. Students in condition 1 received a written lesson on self-efficacy that employed a humorous example. Students in condition 2 received the same lesson but a serious example. Students in condition 2 performed better on a multiple-choice recall test. Study 2 replicated the findings for study 1 using a new student population (more upper-level students), a new lesson (on cohesion in communication), a new learning environment (two different universities), and a new recall test (multiple choice + short answer). This study suggests that using integrated humor to directly teach core course concepts may negatively affect students’ learning of this content because humorous examples “potentially depress students’ ability to retain and transfer the ideas being presented.”

Bolkan, S., Griffin, D. J., & Goodboy, A. K. (2018). Communication Education, 1–21.
[link to article]

Reverse the routine: Problem solving before instruction improves conceptual knowledge in undergraduate physics

Exploratory learning in STEM courses at the university level is a relatively under-researched area. In three studies, researchers tested the effects of completing a collaborative (or solo) learning activity prior to being lectured about that topic (explore-first condition) versus completing the same activity after having the lecture (instruct-first condition). Across two semesters, students in three separate sections of a physics course (N = 362) were randomly assigned to receive either explore-first or instruct-first treatment in groups or individually. After completing both the activity and the lecture (in either order), all students completed a quiz to assess their learning as well as an interest/enjoyment questionnaire. Results showed that students in the explore-first condition tended to struggle more with the activity itself, but performed better on conceptual questions on the quiz than students in the instruct-first condition. There was no difference in performance on procedural quiz questions. Furthermore, students in the explore-first condition reported higher levels of interest and enjoyment. Results also showed that there was no added benefit of exploring in a group over exploring individually, suggesting that the benefits of exploratory learning are not simply driven by working collaboratively with others.  

Weaver, J. P., Chastain, R. J., DeCaro, D. A., & DeCaro, M. S. (2018). Contemporary Educational Psychology52, 36-47.
[link to article]

Peer Mentor Program for the General Chemistry Laboratory Designed To Improve Undergraduate STEM Retention. 

Several hundred undergraduate students enrolled in introductory chemistry labs at a large state university were assigned an upper-class peer mentor to each laboratory section. Instead of grading student work or focusing on course content, the mentor's responsibility was to check in with lab groups to talk about adjusting to college, offer advice on being a successful STEM student, and discuss other relevant topics such as undergraduate research opportunities or pursuing graduate school. After four years of the program, the peer-mentored cohort graduation rate was substantially higher (∼30%) than the non-peer laboratories group, and ∼22% higher than the general student population. 

Damkaci, F.; Braun, T.F.; Gublo, K. (2017). Journal of Chemical Education, ASAP. 
[link to article]

The Dark Side of Interpolated Testing: Frequent Switching Between Retrieval and Encoding Impairs New Learning

In a laboratory experiment using undergraduate participants (N=376), researchers sought to replicate and extend prior work that showed how retrieval practice can impair new learning (see Davis and Chan, 2015). Experimenters had participants switch between retrieval practice trials for a set of previously learned items and trials for the learning of new items at varying frequencies to determine the effects of making that switch has on learning the new content.  Results showed that as the frequency of switching between retrieval practice and new learning increased, the successful learning of the new information decreased. This research suggests that information retrieval and information encoding rely on separate cognitive processes that may compete for the same mental resources, and contributes to our understanding of how the use of interpolated testing could potentially hinder the learning of new information.

Davis, S. D., Chan, J. C., & Wilford, M. M. (2017). Journal of Applied Research in Memory and Cognition.
[link to article]