Metacognition About Practice Testing: a Review of Learners’ Beliefs, Monitoring, and Control of Test-Enhanced Learning

Over a century of research has established practice testing as a highly robust learning strategy that promotes long-term retention. However, learners do not always appreciate the benefits of testing for memory and do not use it as effectively as they could during their own self-regulated learning. The goal of this review is to identify common themes from research focused on learners’ metacognition about practice testing using the three components of metacognition (i.e., beliefs, monitoring, and control) as an organizational guide. To foreshadow the key findings from this research: (1) Without support, learners lack metacognitive awareness of testing as a tool to enhance memory but do recognize that testing can be used as a monitoring tool. (2) Learners can accurately monitor their learning while using practice testing when judgments are made in contexts that are representative of those encountered during a criterion test. (3) In educational contexts, learners report using less effective strategies equally or more often than practice testing. (4) Learners tend to test themselves only under conditions that encourage retrieval success, and rarely use a strategy involving repeated successful retrieval even when it would lead to improved retention. After reviewing research findings, I discuss various interventions that lead to learners using testing more often and more effectively in their own learning and offer recommendations for future research.
This is a preview of subscription content, log in via an institution to check access.
Access this article
Subscribe and save
Springer+ Basic
€32.70 /Month
- Get 10 units per month
- Download Article/Chapter or eBook
- 1 Unit = 1 Article or 1 Chapter
- Cancel anytime
Buy Now
Price includes VAT (France)
Instant access to the full article PDF.
Rent this article via DeepDyve




Similar content being viewed by others
Extending the testing effect to self-regulated learning
Article 01 September 2016

The science of effective learning with spacing and retrieval practice
Article 02 August 2022

Cognitive perspectives on maintaining physicians’ medical expertise: IV. Best practices and open questions in using testing to enhance learning and retention
Article Open access 08 August 2023
Explore related subjects
Notes
These investigations were not included in Table 4 because questions were asked in a way that made it difficult to summarize or the frequency of use by students could not be computed from reported results. For instance, in research by Gurung et al. (2010), students rated their use of strategies on a 1–5 scale.
Although the benefits of practice testing are most robust when retrieval is successful, retrieval success is not always necessary to invoke benefits—as long as learners receive corrective feedback (Kornell et al. 2015). For example, research has found a memory benefit for learners who study cues and generate errorful responses (e.g., whale–?) before receiving feedback (e.g., whale–mammal) compared to those who simply read the cue and target intact (e.g., Kornell et al. 2009; for a review, see Kornell and Vaughn 2016). Learners also appear to be unaware of this “errorful generation effect,” as measured by item-level JOLs, aggregate JOLs, and questionnaires assessing learners’ beliefs (Huelser and Metcalfe 2012; Potts and Shanks 2014; Potts et al. 2019; Yang et al. 2017; Zawadzka and Hanczakowski 2019).
References
* Indicates study included a measure of metacognition about practice testing (see text for eligibility criteria)
- Abel, M., & Bäuml, K. H. T. (2020). Would you like to learn more? Retrieval practice plus feedback can increase motivation to keep on studying. Cognition, 201, 104316. https://doi.org/10.1016/j.cognition.2020.104316. ArticleGoogle Scholar
- Adesope, O. O., Trevisan, D. A., & Sundararajan, N. (2017). Rethinking the use of tests: A meta-analysis of practice testing. Review of Educational Research, 87(3), 659–701. https://doi.org/10.3102/0034654316689306. ArticleGoogle Scholar
- *Agarwal, P. K., D’Antonio, L., Roediger, H. L., McDermott, K. B., & McDaniel, M. A. (2014). Classroom-based programs of retrieval practice reduce middle school and high school students’ test anxiety. Journal of Applied Research in Memory and Cognition, 3(3), 131–139. https://doi.org/10.1016/j.jarmac.2014.07.002.
- *Agarwal, P. K., Karpicke, J. D., Kang, S. H., Roediger, H. L., & McDermott, K. B. (2008). Examining the testing effect with open-and closed-book tests. Applied Cognitive Psychology, 22(7), 861–876. https://doi.org/10.1002/acp.1391.
- Agarwal, P. K., Nunes, L. D., & Blunt, J. R. (2020). Retrieval practice consistently benefits student learning: A systematic review of applied research in schools and classrooms.Manuscript under review. Retrieved from PsyArXiv. https://psyarxiv.com/xe9kvGoogle Scholar
- *Anthenien, A. M., DeLozier, S. J., Neighbors, C., & Rhodes, M. G. (2018). College student normative misperceptions of peer study habit use. Social Psychology of Education, 21(2), 303–322. https://doi.org/10.1007/s11218-017-9412-z.
- Ariel, R., Dunlosky, J., & Bailey, H. (2009). Agenda-based regulation of study-time allocation: When agendas override item-based monitoring. Journal of Experimental Psychology: General, 138(3), 432–447. https://doi.org/10.1037/a0015928. ArticleGoogle Scholar
- *Ariel, R., & Karpicke, J. D. (2018). Improving self-regulated learning with a retrieval practice intervention. Journal of Experimental Psychology: Applied, 24(1), 43–56. https://doi.org/10.1037/xap0000133.
- Artelt, C. (2000). Wie prädiktiv Sind retrospektive Selbstberichte über den Gebrauch von Lernstrategien für strategisches Lernen? [how predictive are self-reported strategies for their actual use?]. Zeitschrift für Pädagogische Psychologie / German Journal of Educational Psychology, 14(2–3), 72–84. https://doi.org/10.1024//1010-0652.14.23.72.
- *Bailey, H., Dunlosky, J., & Hertzog, C. (2009). Metacognitive training at home: Does it improve older adults’ learning?. Gerontology, 56(4), 414–420. https://doi.org/10.1159/000266030.
- Balota, D. A., Duchek, J. M., Sergent-Marshall, S. D., & Roediger, H. L. (2006). Does expanded retrieval produce benefits over equal-interval spacing? Explorations of spacing effects in healthy aging and early stage Alzheimer’s disease. Psychology and Aging, 21(1), 19–31. https://doi.org/10.1037/0882-7974.21.1.19. ArticleGoogle Scholar
- Bangert-Drowns, R. L., Kulik, J. A., & Kulik, C. L. C. (1991). Effects of frequent classroom testing. The Journal of Educational Research, 85(2), 89–99. https://doi.org/10.1080/00220671.1991.10702818. ArticleGoogle Scholar
- Barenberg, J., & Dutke, S. (2019). Testing and metacognition: Retrieval practise effects on metacognitive monitoring in learning from text. Memory, 27(3), 269–279. https://doi.org/10.1080/09658211.2018.1506481. ArticleGoogle Scholar
- *Bartoszewski, B. L., & Gurung, R. A. (2015). Comparing the relationship of learning techniques and exam score. Scholarship of Teaching and Learning in Psychology, 1(3), 219–228. https://doi.org/10.1037/stl0000036.
- Begg, I., Duft, S., Lalonde, P., Melnick, R., & Sanvito, J. (1989). Memory predictions are based on ease of processing. Journal of Memory and Language, 28(5), 610–632. https://doi.org/10.1016/0749-596X(89)90016-8. ArticleGoogle Scholar
- *Bernacki, M. L., Vosicka, L., & Utz, J. C. (2020). Can a brief, digital skill training intervention help undergraduates “learn to learn” and improve their STEM achievement? Journal of Educational Psychology, 112(4), 765–781. https://doi.org/10.1037/edu0000405.
- Bernard, H. R., Killworth, P., Kronenfeld, D., & Sailer, L. (1984). The problem of informant accuracy: The validity of retrospective data. Annual Review of Anthropology, 13(1), 495–517. ArticleGoogle Scholar
- *Biwer, F., oude Egbrink, M. G. A., Aalten, P., & de Bruin, A. B. H. (2020). Fostering effective learning strategies in higher education – A mixed-methods study. Journal of Applied Research in Memory and Cognition, 9(2), 186–203. https://doi.org/10.1016/j.jarmac.2020.03.004.
- Bjork, R. A. (1999). Assessing our own competence: Heuristics and illusions. In D. Gopher & A. Koriat (Eds.), Attention and performance XVII: Cognitive regulation of performance: Interaction of theory and application (pp. 435–459). Cambridge: MIT Press. Google Scholar
- Bjork, R. A., Dunlosky, J., & Kornell, N. (2013). Self-regulated learning: Beliefs, techniques, and illusions. Annual Review of Psychology, 64, 417–444. https://doi.org/10.1146/annurev-psych-113011-143823. ArticleGoogle Scholar
- *Blasiman, R. N., Dunlosky, J., & Rawson, K. A. (2017). The what, how much, and when of study strategies: Comparing intended versus actual study behaviour. Memory, 25(6), 784–792. https://doi.org/10.1080/09658211.2016.1221974.
- *Blunt, J. R., & Karpicke, J. D. (2014). Learning with retrieval-based concept mapping. Journal of Educational Psychology, 106(3), 849–858. https://doi.org/10.1037/a0035934
- *Boehler, M. L., Schwind, C. J., Folse, R., Dunnington, G., Markwell, S., & Dutta, S. (2001). An evaluation of study habits of third-year medical students in a surgical clerkship. The American Journal of Surgery, 181(3), 268–271. https://doi.org/10.1016/S0002-9610(01)00569-4.
- *Bottiroli, S., Dunlosky, J., Guerini, K., Cavallini, E., & Hertzog, C. (2010). Does task affordance moderate age-related deficits in strategy production?. Aging, Neuropsychology, and Cognition, 17(5), 591–602. https://doi.org/10.1080/13825585.2010.481356.
- Bouwmeester, S., & Verkoeijen, P. P. (2011). Why do some children benefit more from testing than others? Gist trace processing to explain the testing effect. Journal of Memory and Language, 65(1), 32–41. https://doi.org/10.1016/j.jml.2011.02.005. ArticleGoogle Scholar
- Butler, A. C., Karpicke, J. D., & Roediger, H. L. (2007). The effect of type and timing of feedback on learning from multiple-choice tests. Journal of Experimental Psychology: Applied, 13(4), 273–281. https://doi.org/10.1037/1076-898X.13.4.273. ArticleGoogle Scholar
- *Burgess, S. R., & Murray, A. B. (2014). Use of traditional and smartphone app flashcards in an introductory psychology class. Journal of Instructional Pedagogies, 13.
- Butler, A. C., & Roediger, H. L. (2007). Testing improves long-term retention in a simulated classroom setting. European Journal of Cognitive Psychology, 19(4–5), 514–527. https://doi.org/10.1080/09541440701326097. ArticleGoogle Scholar
- Carpenter, S. K. (2012). Testing enhances the transfer of learning. Current Directions in Psychological Science, 21(5), 279–283. https://doi.org/10.1177/0963721412452728. ArticleGoogle Scholar
- *Carrillo-de-la-Peña, M. T., Bailles, E., Caseras, X., Martínez, À., Ortet, G., & Pérez, J. (2009). Formative assessment and academic achievement in pre-graduate students of health sciences. Advances in Health Sciences Education, 14(1), 61–67. https://doi.org/10.1007/s10459-007-9086-y.
- *Carpenter, S. K., Lund, T. J., Coffman, C. R., Armstrong, P. I., Lamm, M. H., & Reason, R. D. (2016). A classroom study on the relationship between student achievement and retrieval-enhanced learning. Educational Psychology Review, 28(2), 353–375. https://doi.org/10.1007/s10648-015-9311-9.
- *Carrier, L. M. (2003). College students’ choices of study strategies. Perceptual and Motor Skills, 96(1), 54–56. https://doi.org/10.2466/pms.2003.96.1.54.
- Clark, D. A., & Svinicki, M. (2015). The effect of retrieval on post-task enjoyment of studying. Educational Psychology Review, 27(1), 51–67. https://doi.org/10.1007/s10648-014-9272-4. ArticleGoogle Scholar
- Cogliano, M., Kardash, C. M., & Bernacki, M. L. (2019). The effects of retrieval practice and prior topic knowledge on test performance and confidence judgments. Contemporary Educational Psychology, 56, 117–129. https://doi.org/10.1016/j.cedpsych.2018.12.001. ArticleGoogle Scholar
- Cohen, M. S., Yan, V. X., Halamish, V., & Bjork, R. A. (2013). Do students think that difficult or valuable materials should be restudied sooner rather than later? Journal of Experimental Psychology: Learning, Memory, and Cognition, 39(6), 1682–1696. https://doi.org/10.1037/a0032425. ArticleGoogle Scholar
- Corral, D., Carpenter, S. K., Perkins, K., & Gentile, D. A. (2020). Assessing students’ use of optional online lecture reviews. Applied Cognitive Psychology,34(2), 318–329. https://doi.org/10.1002/acp.3618
- Credé, M., & Phillips, L. A. (2011). A meta-analytic review of the Motivated Strategies for Learning Questionnaire. Learning and Individual Differences, 21(4), 337–346. https://doi.org/10.1016/j.lindif.2011.03.002. ArticleGoogle Scholar
- Dembo, M. H., & Seli, H. P. (2004). Students’ resistance to change in learning strategies courses. Journal of Developmental Education, 27(3), 2–11. Google Scholar
- *Deng, F., Gluckstein, J. A., & Larsen, D. P. (2015). Student-directed retrieval practice is a predictor of medical licensing examination performance. Perspectives on Medical Education, 4(6), 308–313. https://doi.org/10.1007/s40037-015-0220-x. ArticleGoogle Scholar
- DePaolo, C. A., & Wilkinson, K. (2014). Recurrent online quizzes: Ubiquitous tools for promoting student presence, participation and performance. Interdisciplinary Journal of E-Learning and Learning Objects, 10(1), 75–91. Google Scholar
- *Dirkx, K. J. H., Camp, G., Kester, L., & Kirschner, P. A. (2019). Do secondary school students make use of effective study strategies when they study on their own?. Applied Cognitive Psychology, 33(5), 952–957. https://doi.org/10.1002/acp.3584. ArticleGoogle Scholar
- Dolmans, D. H., De Grave, W., Wolfhagen, I. H., & Van Der Vleuten, C. P. (2005). Problem-based learning: Future challenges for educational practice and research. Medical Education, 39(7), 732–741. https://doi.org/10.1111/j.1365-2929.2005.02205.x. ArticleGoogle Scholar
- Dunlosky, J., & Ariel, R. (2011). Self-regulated learning and the allocation of study time. In Psychology of learning and motivation (Vol. 54, pp. 103–140). Cambridge: Academic Press. Google Scholar
- Dunlosky, J., & Hertzog, C. (1998). Training programs to improve learning in later adulthood: Helping older adults educate themselves. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Metacognition in educational theory and practice (pp. 263–290). Abington: Routledge. Google Scholar
- Dunlosky, J., & Hertzog, C. (2000). Updating knowledge about encoding strategies: A componential analysis of learning about strategy effectiveness from task experience. Psychology and Aging, 15(3), 462–474. https://doi.org/10.1037/0882-7974.15.3.462. ArticleGoogle Scholar
- *Dunlosky, J., Kubat-Silman, A. K., & Hertzog, C. (2003). Training monitoring skills improves older adults' self-paced associative learning. Psychology and Aging, 18(2), 340–345. https://doi.org/10.1037/0882-7974.18.2.340. ArticleGoogle Scholar
- Dunlosky, J., & Metcalfe, J. (2000). Metacognition. New York: Sage Publications. https://doi.org/10.1111/j.1467-8721.2009.01628.x. BookGoogle Scholar
- Dunlosky, J., & Nelson, T. O. (1992). Importance of the kind of cue for judgments of learning (JOL) and the delayed-JOL effect. Memory & Cognition, 20(4), 374–380. https://doi.org/10.3758/BF03210921. ArticleGoogle Scholar
- Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013). Improving students’ learning with effective learning techniques: Promising directions from cognitive and educational psychology. Psychological Science in the Public Interest, 14(1), 4–58. https://doi.org/10.1177/1529100612453266. ArticleGoogle Scholar
- Dunlosky, J., & Rawson, K. A. (2012). Overconfidence produces underachievement: Inaccurate self evaluations undermine students’ learning and retention. Learning and Instruction, 22(4), 271–280. https://doi.org/10.1016/j.learninstruc.2011.08.003. ArticleGoogle Scholar
- *Dunlosky, J., & Rawson, K. A. (2015). Do students use testing and feedback while learning? A focus on key concept definitions and learning to criterion. Learning and Instruction, 39, 32–44. https://doi.org/10.1016/j.learninstruc.2015.05.003. ArticleGoogle Scholar
- Ebersbach, M., Feierabend, M., & Barzagar Nazari, K. (2020). Comparing the effects of generating questions, testing, and restudying on students’ long-term recall in university learning. Applied Cognitive Psychology. https://doi.org/10.1002/acp.3639.
- Efklides, A. (2006). Metacognition and affect: What can metacognitive experiences tell us about the learning process? Educational Research Review, 1(1), 3–14. https://doi.org/10.1016/j.edurev.2005.11.001. ArticleGoogle Scholar
- *Einstein, G. O., Mullet, H. G., & Harrison, T. L. (2012). The testing effect: Illustrating a fundamental concept and changing study strategies. Teaching of Psychology, 39(3), 190–193. https://doi.org/10.1177/0098628312450432. ArticleGoogle Scholar
- *Ekuni, R., de Souza, B. M. N., Agarwal, P. K., & Pompeia, S. (2020). A conceptual replication of survey research on study strategies in a diverse, non-WEIRD student population. Scholarship of Teaching and Learning in Psychology.https://doi.org/10.1037/stl0000191.
- Ericsson, K. A., & Simon, H. A. (1980). Verbal reports as data. Psychological Review, 87(3), 215–251. https://doi.org/10.1037/0033-295X.87.3.215. ArticleGoogle Scholar
- Fernandez, J., & Jamet, E. (2017). Extending the testing effect to self-regulated learning. Metacognition and Learning, 12(2), 131–156. https://doi.org/10.1007/s11409-016-9163-9. ArticleGoogle Scholar
- Flavell, J. H. (1979). Metacognition and cognitive monitoring: A new area of cognitive–developmental inquiry. American Psychologist, 34(10), 906–911. https://doi.org/10.1037/0003-066X.34.10.906. ArticleGoogle Scholar
- *Fritz, C. O., Morris, P. E., Acton, M., Voelkel, A. R., & Etkind, R. (2007). Comparing and combining retrieval practice and the keyword mnemonic for foreign vocabulary learning. Applied Cognitive Psychology, 21(4), 499–526. https://doi.org/10.1002/acp.1287. ArticleGoogle Scholar
- *Gagnon, M., & Cormier, S. (2019). Retrieval practice and distributed practice: The case of French Canadian students. Canadian Journal of School Psychology, 34(2), 83–97. https://doi.org/10.1177/0829573518773225. ArticleGoogle Scholar
- Gaynor, J., & Millham, J. (1976). Student performance and evaluation under variant teaching and testing methods in a large college course. Journal of Educational Psychology, 68(3), 312–317. https://doi.org/10.1037/0022-0663.68.3.312. ArticleGoogle Scholar
- *Geller, J., Toftness, A. R., Armstrong, P. I., Carpenter, S. K., Manz, C. L., Coffman, C. R., & Lamm, M. H. (2017). Study strategies and beliefs about learning as a function of academic achievement and achievement goals. Memory, 26(5), 683–690. https://doi.org/10.1080/09658211.2017.1397175. ArticleGoogle Scholar
- *Goetz, E. T., & Palmer, D. J. (1991). The role of students’ perceptions of study strategies and personal attributes in strategy use. Reading Psychology: An International Quarterly, 12(3), 199–217. https://doi.org/10.1080/0270271910120302. ArticleGoogle Scholar
- *Golding, J. M., Wasarhaley, N. E., & Fletcher, B. (2012). The use of flashcards in an introduction to psychology class. Teaching of Psychology, 39(3), 199–202. https://doi.org/10.1177/0098628312450436. ArticleGoogle Scholar
- Greene, J. A., & Azevedo, R. (2009). A macro-level analysis of SRL processes and their relations to the acquisition of a sophisticated mental model of a complex system. Contemporary Educational Psychology, 34(1), 18–29. https://doi.org/10.1016/j.cedpsych.2008.05.006. ArticleGoogle Scholar
- *Gurung, R. A. (2005). How do students really study (and does it matter). Teaching of Psychology, 39, 323–340. Google Scholar
- *Gurung, R. A., Weidert, J., & Jeske, A. (2010). Focusing on how students study. Journal of the Scholarship of Teaching and Learning, 28–35.
- Hacker, D. J., & Bol, L. (2019). Calibration and self-regulated learning making the connections. In J. Dunlosky & K. A. Rawson (Eds.), Handbook of cognition and education (pp. 647–677). Cambridge: Cambridge University Press. ChapterGoogle Scholar
- *Hagemeier, N. E., & Mason, H. L. (2011). Student pharmacists' perceptions of testing and study strategies. American Journal of Pharmaceutical Education, 75(2). https://doi.org/10.5688/ajpe75235.
- *Hartwig, M. K., & Dunlosky, J. (2012). Study strategies of college students: Are self-testing and scheduling related to achievement?. Psychonomic Bulletin & Review, 19(1), 126–134. https://doi.org/10.3758/s13423-011-0181-y. ArticleGoogle Scholar
- *Hinze, S. R., & Rapp, D. N. (2014). Retrieval (sometimes) enhances learning: Performance pressure reduces the benefits of retrieval practice. Applied Cognitive Psychology, 28(4), 597–606. https://doi.org/10.1002/acp.3032. ArticleGoogle Scholar
- *Hora, M. T., & Oleson, A. K. (2017). Examining study habits in undergraduate STEM courses from a situative perspective. International Journal of STEM Education, 4(1). https://doi.org/10.1186/s40594-017-0055-6.
- *Hotta, C., Tajika, H., & Neumann, E. (2014). Students’ free studying after training with instructions about the mnemonic benefits of testing: Do students use self-testing spontaneously?. International Journal of Advances in Psychology, 3(4). 139–143. ArticleGoogle Scholar
- Hunter, A. S., & Lloyd, M. E. (2018). Faculty discuss study strategies, but not the best ones: A survey of suggested exam preparation techniques for difficult courses across disciplines. Scholarship of Teaching and Learning in Psychology, 4(2), 105–114. https://doi.org/10.1037/stl0000107. ArticleGoogle Scholar
- Huelser, B. J., & Metcalfe, J. (2012). Making related errors facilitates learning, but learners do not know it. Memory & Cognition, 40(4), 514–527. https://doi.org/10.3758/s13421-011-0167-z. ArticleGoogle Scholar
- *Jacoby, L. L., Wahlheim, C. N., & Coane, J. H. (2010). Test-enhanced learning of natural concepts: Effects on recognition memory, classification, and metacognition. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36(6), 1441–1451. https://doi.org/10.1037/a0020636. ArticleGoogle Scholar
- Jamieson-Noel, D., & Winne, P. H. (2003). Comparing self-reports to traces of studying behavior as representations of students' studying and achievement. German Journal of Educational Psychology, 17(3–4), 159–171. https://doi.org/10.1024//1010-0652.17.34.159. ArticleGoogle Scholar
- *Janes, J. L., Dunlosky, J., & Rawson, K. A. (2018). How do students use self-testing across multiple study sessions when preparing for a high-stakes exam?. Journal of Applied Research in Memory and Cognition, 7(2), 230–240. https://doi.org/10.1016/j.jarmac.2017.11.003. ArticleGoogle Scholar
- *Johnson, G. (2006). Optional online quizzes: College student use and relationship to achievement. Canadian Journal of Learning and Technology/La revue canadienne de l’apprentissage et de la technologie, 32(1).
- *Johnson, C. I., & Mayer, R. E. (2009). A testing effect with multimedia learning. Journal of Educational Psychology, 101(3), 621–629. https://doi.org/10.1037/a0015183. ArticleGoogle Scholar
- *Jones, A. C., Wardlow, L., Pan, S. C., Zepeda, C., Heyman, G. D., Dunlosky, J., & Rickard, T. C. (2016). Beyond the rainbow: Retrieval practice leads to better spelling than does rainbow writing. Educational Psychology Review, 28(2), 385–400. https://doi.org/10.1007/s10648-015-9330-6. ArticleGoogle Scholar
- *Kang, S. H. (2010). Enhancing visuospatial learning: The benefit of retrieval practice. Memory & Cognition, 38(8), 1009–1017. https://doi.org/10.3758/MC.38.8.1009. ArticleGoogle Scholar
- *Karpicke, J. D. (2009). Metacognitive control and strategy selection: Deciding to practice retrieval during learning. Journal of Experimental Psychology: General, 138(4), 469–486. https://doi.org/10.1037/a0017341. ArticleGoogle Scholar
- Karpicke, J. D. (2012). Retrieval-based learning: Active retrieval promotes meaningful learning. Current Directions in Psychological Science, 21(3), 157–163. https://doi.org/10.1177/0963721412443552. ArticleGoogle Scholar
- *Karpicke, J. D., & Blunt, J. R. (2011). Retrieval practice produces more learning than elaborative studying with concept mapping. Science, 331(6018), 772–775. https://doi.org/10.1126/science.1199327. ArticleGoogle Scholar
- *Karpicke, J. D., Blunt, J. R., Smith, M. A., & Karpicke, S. S. (2014). Retrieval-based learning: The need for guided retrieval in elementary school children. Journal of Applied Research in Memory and Cognition, 3(3), 198–206. https://doi.org/10.1016/j.jarmac.2014.07.008. ArticleGoogle Scholar
- *Karpicke, J. D., Butler, A. C., & Roediger, H. L. (2009). Metacognitive strategies in student learning: Do students practise retrieval when they study on their own?. Memory, 17(4), 471–479. https://doi.org/10.1080/09658210802647009. ArticleGoogle Scholar
- Karpicke, J. D., & Grimaldi, P. J. (2012). Retrieval-based learning: A perspective for enhancing meaningful learning. Educational Psychology Review, 24(3), 401–418. https://doi.org/10.1007/s10648-012-9202-2. ArticleGoogle Scholar
- *Karpicke, J. D., & Roediger, H. L. (2008). The critical importance of retrieval for learning. Science, 319(5865), 966–968. https://doi.org/10.1126/science.1152408. ArticleGoogle Scholar
- Khanna, M. M. (2015). Ungraded pop quizzes: Test-enhanced learning without all the anxiety. Teaching of Psychology, 42(2), 174–178. https://doi.org/10.1177/0098628315573144. ArticleGoogle Scholar
- *Kibble, J. (2007). Use of unsupervised online quizzes as formative assessment in a medical physiology course: Effects of incentives on student participation and performance. Advances in Physiology Education, 31(3), 253–260. https://doi.org/10.1152/advan.00027.2007. ArticleGoogle Scholar
- *Kibble, J. D. (2011). Voluntary participation in online formative quizzes is a sensitive predictor of student success. Advances in Physiology Education, 35(1), 95–96. https://doi.org/10.1152/advan.00053.2010. ArticleGoogle Scholar
- King, J. F., Zechmeister, E. B., & Shaughnessy, J. J. (1980). Judgments of knowing: The influence of retrieval practice. The American Journal of Psychology, 93(2), 329–343. https://doi.org/10.2307/1422236. ArticleGoogle Scholar
- *Kirk-Johnson, A., Galla, B. M., & Fraundorf, S. H. (2019). Perceiving effort as poor learning: The misinterpreted-effort hypothesis of how experienced effort and perceived learning relate to study strategy choice. Cognitive Psychology, 115, 101237. https://doi.org/10.1016/j.cogpsych.2019.101237. ArticleGoogle Scholar
- Koriat, A. (1997). Monitoring one's own knowledge during study: A cue-utilization approach to judgments of learning. Journal of Experimental Psychology: General, 126(4), 349–370. https://doi.org/10.1037/0096-3445.126.4.349. ArticleGoogle Scholar
- Koriat, A. (2008). Easy comes, easy goes? The link between learning and remembering and its exploitation in metacognition. Memory & Cognition, 36(2), 416–428. https://doi.org/10.3758/MC.36.2.416. ArticleGoogle Scholar
- Koriat, A., & Bjork, R. A. (2006). Mending metacognitive illusions: A comparison of mnemonic-based and theory-based procedures. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32(5), 1133–1145. https://doi.org/10.1037/0278-7393.32.5.1133. ArticleGoogle Scholar
- Koriat, A., & Levy-Sadot, R. (1999). Processes underlying metacognitive judgments: Information-based and experience-based monitoring of one’s own knowledge. In S. Chaiken & Y. Trope (Eds.), Dual-process theories in social psychology (p. 483–502). Guilford Press.
- *Kornell, N., & Bjork, R. A. (2007). The promise and perils of self-regulated study. Psychonomic Bulletin & Review, 14(2), 219–224. https://doi.org/10.3758/BF03194055. ArticleGoogle Scholar
- Kornell, N., & Bjork, R. A. (2008). Optimising self-regulated study: The benefits—and costs—of dropping flashcards. Memory, 16(2), 125–136. https://doi.org/10.1080/09658210701763899. ArticleGoogle Scholar
- Kornell, N., & Finn, B. (2016). Self-regulated learning: An overview of theory and data. In J. Dunlosky & S. K. Tauber (Eds.), The Oxford handbook of metamemory, (pp. 325–340). Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199336746.013.23.
- Kornell, N., Hays, M. J., & Bjork, R. A. (2009). Unsuccessful retrieval attempts enhance subsequent learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 35(4), 989–998. https://doi.org/10.1037/a0015729. ArticleGoogle Scholar
- Kornell, N., Klein, P. J., & Rawson, K. A. (2015). Retrieval attempts enhance learning, but retrieval success (versus failure) does not matter. Journal of Experimental Psychology: Learning, Memory, and Cognition, 41(1), 283–294. https://doi.org/10.1037/a0037850. ArticleGoogle Scholar
- *Kornell, N., & Rhodes, M. G. (2013). Feedback reduces the metacognitive benefit of tests. Journal of Experimental Psychology: Applied, 19(1), 1–13. https://doi.org/10.1037/a0032147. ArticleGoogle Scholar
- *Kornell, N., & Son, L. K. (2009). Learners’ choices and beliefs about self-testing. Memory, 17(5), 493–501. https://doi.org/10.1080/09658210902832915. ArticleGoogle Scholar
- Kornell, N., & Vaughn, K. E. (2016). How retrieval attempts affect learning: A review and synthesis. In Psychology of learning and motivation (Vol. 65, pp. 183–215). Cambridge: Academic Press. https://doi.org/10.1016/bs.plm.2016.03.003. ChapterGoogle Scholar
- *Kuhbandner, C., & Emmerdinger, K. J. (2019). Do students really prefer repeated rereading over testing when studying textbooks? A reexamination. Memory, 27(7), 952–961. https://doi.org/10.1080/09658211.2019.1610177. ArticleGoogle Scholar
- *LaDisa, A. G., & Biesboer, A. (2017). Incorporation of practice testing to improve knowledge acquisition in a pharmacotherapy course. Currents in Pharmacy Teaching & Learning, 9(4), 660–665. https://doi.org/10.1016/j.cptl.2017.03.002. ArticleGoogle Scholar
- *Larsen, D. P., Butler, A. C., & Roediger, H. L. (2013). Comparative effects of test-enhanced learning and self-explanation on long-term retention. Medical Education, 47(7), 674–682. https://doi.org/10.1111/medu.12141. ArticleGoogle Scholar
- *Lechuga, M. T., Ortega-Tudela, J. M., & Gómez-Ariza, C. J. (2015). Further evidence that concept mapping is not better than repeated retrieval as a tool for learning from texts. Learning and Instruction, 40, 61–68. https://doi.org/10.1016/j.learninstruc.2015.08.002. ArticleGoogle Scholar
- Leeming, F. C. (2002). The exam-a-day procedure improves performance in psychology classes. Teaching of Psychology, 29(3), 210–212. https://doi.org/10.1207/S15328023TOP2903_06. ArticleGoogle Scholar
- *Linderholm, T., Dobson, J., & Yarbrough, M. B. (2016). The benefit of self-testing and interleaving for synthesizing concepts across multiple physiology texts. Advances in Physiology Education, 40(3), 329–334. https://doi.org/10.1152/advan.00157.2015. ArticleGoogle Scholar
- *Lineweaver, T. T., Hall, A. C., Hilycord, D., & Vitelli, S. E. (2019). Introducing and evaluating a “Study Smarter, Not Harder” study tips presentation offered to incoming students at a four-year university. Journal of the Scholarship of Teaching and Learning, 19(2), 16–46. https://doi.org/10.14434/josotl.v19i1.23734.
- *Lipowski, S. L., Pyc, M. A., Dunlosky, J., & Rawson, K. A. (2014). Establishing and explaining the testing effect in free recall for young children. Developmental Psychology, 50(4), 994–1000. https://doi.org/10.1037/a0035202. ArticleGoogle Scholar
- *Little, J. L., & McDaniel, M. A. (2015). Metamemory monitoring and control following retrieval practice for text. Memory & Cognition, 43(1), 85–98. https://doi.org/10.3758/s13421-014-0453-7. ArticleGoogle Scholar
- LoGiudice, A. B., Pachai, A. A., & Kim, J. A. (2015). Testing together: When do students learn more through collaborative tests? Scholarship of Teaching and Learning in Psychology, 1(4), 377–389. https://doi.org/10.1037/stl0000041. ArticleGoogle Scholar
- *Luo, B. (2019). The influence of teaching learning techniques on students’ long-term learning behavior. Computer Assisted Language Learning, 1-25. https://doi.org/10.1080/09588221.2019.1567557. ChapterGoogle Scholar
- Lull, M. E., & Mathews, J. L. (2016). Online self-testing resources prepared by peer tutors as a formative assessment tool in pharmacology courses. American Journal of Pharmaceutical Education, 80(7). https://doi.org/10.5688/ajpe807124.
- Lyle, K. B., & Crawford, N. A. (2011). Retrieving essential material at the end of lectures improves performance on statistics exams. Teaching of Psychology, 38(2), 94–97. https://doi.org/10.1177/0098628311401587. ArticleGoogle Scholar
- *Mackenzie, A. M. (1994). Examination preparation, anxiety and examination performance in a group of adult students. International Journal of Lifelong Education, 13(5), 373–388. https://doi.org/10.1080/0260137940130504. ArticleGoogle Scholar
- *Maddox, G. B., & Balota, D. A. (2012). Self control of when and how much to test face–name pairs in a novel spaced retrieval paradigm: An examination of age-related differences. Aging, Neuropsychology, and Cognition, 19(5), 620–643. https://doi.org/10.1080/13825585.2011.640658. ArticleGoogle Scholar
- Mayer, R. E., Stull, A., DeLeeuw, K., Almeroth, K., Bimber, B., Chun, D., Bulger, M., Campbell, J., Knight, A., & Zhang, H. (2009). Clickers in college classrooms: Fostering learning with questioning methods in large lecture classes. Contemporary Educational Psychology, 34(1), 51–57. https://doi.org/10.1016/j.cedpsych.2008.04.002. ArticleGoogle Scholar
- *McAndrew, M., Kamboj, R. S., & Pierre, G. C. (2015). Do dental students use optimal study strategies?. Journal of Dental Education, 79(1), 33–37. https://doi.org/10.1002/j.0022-0337.2015.79.1.tb05854.x. ArticleGoogle Scholar
- *McAndrew, M., Morrow, C. S., Atiyeh, L., & Pierre, G. C. (2016). Dental student study strategies: Are self-testing and scheduling related to academic performance?. Journal of Dental Education, 80(5), 542–552. https://doi.org/10.1002/j.0022-0337.2016.80.5.tb06114.x. ArticleGoogle Scholar
- *McCabe, J. (2011). Metacognitive awareness of learning strategies in undergraduates. Memory & Cognition, 39(3), 462–476. https://doi.org/10.3758/s13421-010-0035-2. ArticleGoogle Scholar
- *McCabe, J. A. (2018). What learning strategies do academic support centers recommend to undergraduates?. Journal of Applied Research in Memory and Cognition, 7(1), 143–153. https://doi.org/10.1016/j.jarmac.2017.10.002. ArticleGoogle Scholar
- *McCabe, J. A., & Lummis, S. N. (2018). Why and how do undergraduates study in groups?. Scholarship of Teaching and Learning in Psychology, 4(1), 27–42. https://doi.org/10.1037/stl0000099. ArticleGoogle Scholar
- McDaniel, M. A., Agarwal, P. K., Huelser, B. J., McDermott, K. B., & Roediger, H. L. (2011). Test-enhanced learning in a middle school science classroom: The effects of quiz frequency and placement. Journal of Educational Psychology, 103(2), 399–414. https://doi.org/10.1037/a0021782. ArticleGoogle Scholar
- McDaniel, M. A., & Einstein, G. O. (2020). Training learning strategies to promote self-regulation and transfer: The knowledge, belief, commitment, and planning framework. Perspectives on Psychological Science. https://doi.org/10.1177/1745691620920723.
- McDaniel, M. A., & Little, J. L. (2019). Multiple-choice and short-answer quizzing on equal footing in the classroom: Potential indirect effects of testing. In J. Dunlosky & K. Rawson (Eds.), Handbook of cognition and education (pp. 480–499). Cambridge: Cambridge University Press. https://doi.org/10.1017/9781108235631.020. ChapterGoogle Scholar
- *McNulty, J. A., Ensminger, D. C., Hoyt, A. E., Chandrasekhar, A. J., Gruener, G., & Espiritu, B. (2012). Study strategies are associated with performance in basic science courses in the medical curriculum. Journal of Education and Learning, 1(1), 1. ArticleGoogle Scholar
- Metcalfe, J. (2002). Is study time allocated selectively to a region of proximal learning? Journal of Experimental Psychology: General, 131(3), 349–363. https://doi.org/10.1037/0096-3445.131.3.349. ArticleGoogle Scholar
- Metcalfe, J., & Finn, B. (2008). Evidence that judgments of learning are causally related to study choice. Psychonomic Bulletin & Review, 15(1), 174–179. https://doi.org/10.3758/PBR.15.1.174. ArticleGoogle Scholar
- Miller, T. M., & Geraci, L. (2014). Improving metacognitive accuracy: How failing to retrieve practice items reduces overconfidence. Consciousness and Cognition, 29, 131–140. https://doi.org/10.1016/j.concog.2014.08.008. ArticleGoogle Scholar
- Molin, F., Cabus, S., Haelermans, C., & Groot, W. (2019). Toward reducing anxiety and increasing performance in physics education: Evidence from a randomized experiment. In Research in Science Education (pp. 1–17). https://doi.org/10.1007/s11165-019-9845-9. ChapterGoogle Scholar
- *Morehead, K., Rhodes, M. G., & DeLozier, S. (2016). Instructor and student knowledge of study strategies. Memory, 24(2), 257–271. https://doi.org/10.1080/09658211.2014.1001992. ArticleGoogle Scholar
- Moryl, R. L., Gabriele, F., & Desvira, J. (2019). HeadsUp! Econ: Making exam review sessions fun and effective. The Journal of Economic Education, 50(4), 388–397. https://doi.org/10.1080/00220485.2019.1654953. ArticleGoogle Scholar
- Mueller, M. L., Dunlosky, J., & Tauber, S. K. (2015). Why is knowledge updating after task experience incomplete? Contributions of encoding experience, scaling artifact, and inferential deficit. Memory & Cognition, 43(2), 180–192. https://doi.org/10.3758/s13421-014-0474-2. ArticleGoogle Scholar
- *Murray, S., Phelps, J. & Altabbakh, H. (2018). Enhancing exam prep with customized digital flashcards. Journal of STEM Education: Innovations and Research, 19(4).
- *Murphy, M. D., Schmitt, F. A., Caruso, M. J., & Sanders, R. E. (1987). Metamemory in older adults: The role of monitoring in serial recall. Psychology and Aging, 2(4), 331–339. https://doi.org/10.1037/0882-7974.2.4.331. ArticleGoogle Scholar
- Nelson, T. O. (1996). Consciousness and metacognition. American Psychologist, 51(2), 102–116. https://doi.org/10.1037/0003-066X.51.2.102. ArticleGoogle Scholar
- Nelson, T. O., & Narens, L. (1990). Metamemory: A theoretical framework and new findings. The Psychology of Learning and Motivation, 26, 125–141. https://doi.org/10.1016/S0079-7421(08)60053-5. ArticleGoogle Scholar
- Nelson, T. O., & Narens, L. (1994). Why investigate metacognition. In J. Metcalfe & A. P. Shimamura (Eds.), Metacognition: Knowing about knowing (pp. 1–25). Cambridge: MIT Press. Google Scholar
- Nelson, T. O., Narens, L., & Dunlosky, J. (2004). A revised methodology for research on metamemory: Pre-judgment recall and monitoring (PRAM). Psychological Methods,9(1), 53–69. https://doi.org/10.1037/1082-989X.9.1.53ArticleGoogle Scholar
- Nisbett, R. E., & Wilson, T. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84(3), 231–259. https://doi.org/10.1037/0033-295X.84.3.231. ArticleGoogle Scholar
- Nguyen, K., & McDaniel, M. A. (2015). Using quizzing to assist student learning in the classroom: The good, the bad, and the ugly. Teaching of Psychology, 42(1), 87–92. https://doi.org/10.1177/0098628314562685. ArticleGoogle Scholar
- *Nyroos, M., Schéle, I., & Wiklund-Hörnqvist, C. (2016). Implementing test enhanced learning: Swedish teacher students' perception of quizzing. International Journal of Higher Education, 5(4), 1–12. https://doi.org/10.5430/ijhe.v5n4p1ArticleGoogle Scholar
- *O’Day, G. M., & Karpicke, J. D. (2020). Comparing and combining retrieval practice and concept mapping. Journal of Educational Psychologyhttps://doi.org/10.1037/edu0000486.
- *Olson, B. L., & McDonald, J. L. (2004). Influence of online formative assessment upon student learning in biomedical science courses. Journal of Dental Education, 68(6), 656–659. https://doi.org/10.1002/j.0022-0337.2004.68.6.tb03783.x. ArticleGoogle Scholar
- *Palmer, S., Chu, Y., & Persky, A. M. (2019). Comparison of rewatching class recordings versus retrieval practice as post-lecture learning strategies. American Journal of Pharmaceutical Education, 83(9). https://doi.org/10.5688/ajpe7217.
- Pan, S. C., & Rickard, T. C. (2018). Transfer of test-enhanced learning: Meta-analytic review and synthesis. Psychological Bulletin, 144(7), 710–756. https://doi.org/10.1037/bul0000151. ArticleGoogle Scholar
- *Pan, S. C., Rubin, B. R., & Rickard, T. C. (2015). Does testing with feedback improve adult spelling skills relative to copying and reading?. Journal of Experimental Psychology: Applied, 21(4), 356–369. https://doi.org/10.1037/xap0000062. ArticleGoogle Scholar
- Patil, R., & Iyer, P. (2016). Perceptions of undergraduate medical students on use of flashcards as a mode of learning anatomy. National Journal of Integrated Research in Medicine, 7(2), 110–112. Google Scholar
- *Persky, A. M. (2018). A four year longitudinal study of student learning strategies. Currents in Pharmacy Teaching & Learning, 10(11), 1496–1500. https://doi.org/10.1016/j.cptl.2018.08.012. ArticleGoogle Scholar
- *Persky, A. M., & Hudson, S. L. (2016). A snapshot of student study strategies across a professional pharmacy curriculum: Are students using evidence-based practice?. Currents in Pharmacy Teaching & Learning, 8(2), 141–147. https://doi.org/10.1016/j.cptl.2015.12.010. ArticleGoogle Scholar
- Phelps, R. P. (2019). Test frequency, stakes, and feedback in student achievement: A meta-analysis. Evaluation Review, 1–41. https://doi.org/10.1177/0193841X19865628.
- Pierce, B. H., & Smith, S. M. (2001). The postdiction superiority effect in metacomprehension of text. Memory & Cognition, 29(1), 62–67. https://doi.org/10.3758/BF03195741. ArticleGoogle Scholar
- Pintrich, P. R., Smith, D. A., Garcia, T., & McKeachie, W. J. (1993). Reliability and predictive validity of the motivated strategies for learning questionnaire (MSLQ). Educational and Psychological Measurement, 53(3), 801–813. https://doi.org/10.1177/0013164493053003024. ArticleGoogle Scholar
- *Piza, F., Kesselheim, J. C., Perzhinsky, J., Drowos, J., Gillis, R., Moscovici, K., Danciu, T. T., Kosowska, A., & Gooding, H. (2019). Awareness and usage of evidence-based learning strategies among health professions students and faculty. Medical Teacher, 41(12), 1411–1418. https://doi.org/10.1080/0142159X.2019.1645950. ArticleGoogle Scholar
- Pomerance, L., Greenberg, J., & Walsh, K. (2016). Learning about learning: What every new teacher needs to know.National Council on Teacher Quality. Google Scholar
- Potts, R., & Shanks, D. R. (2014). The benefit of generating errors during learning. Journal of Experimental Psychology: General, 143(2), 644–667. https://doi.org/10.1037/a0033194. ArticleGoogle Scholar
- Potts, R., Davies, G., & Shanks, D. R. (2019). The benefit of generating errors during learning: What is the locus of the effect? Journal of Experimental Psychology: Learning, Memory, and Cognition, 45(6), 1023–1041. https://doi.org/10.1037/xlm0000637. ArticleGoogle Scholar
- Putnam, A. L., Sungkhasettee, V. W., & Roediger, H. L. (2016). Optimizing learning in college: Tips from cognitive psychology. Perspectives on Psychological Science, 11(5), 652–660. https://doi.org/10.1177/1745691616645770. ArticleGoogle Scholar
- Pyc, M. A., & Rawson, K. A. (2009). Testing the retrieval effort hypothesis: Does greater difficulty correctly recalling information lead to higher levels of memory? Journal of Memory and Language, 60(4), 437–447. https://doi.org/10.1016/j.jml.2009.01.004. ArticleGoogle Scholar
- Pyc, M. A., & Rawson, K. A. (2012). Are judgments of learning made after correct responses during retrieval practice sensitive to lag and criterion level effects? Memory & Cognition, 40(6), 976–988. https://doi.org/10.3758/s13421-012-0200-x. ArticleGoogle Scholar
- Rawson, K. A., & Dunlosky, J. (2012). When is practice testing most effective for improving the durability and efficiency of student learning? Educational Psychology Review, 24(3), 419–435. https://doi.org/10.1007/s10648-012-9203-1. ArticleGoogle Scholar
- *Reinhardt, N., Wenzel, K., & Reinhard, M. A. (2019). Am I responsible for my learning success? A study about the correlation between locus of control and attitudes towards and self-reported use of desirable difficulties. Journal of Psychological and Educational Research, 27(1), 7–24. Google Scholar
- Rhodes, M. G., & Tauber, S. K. (2011). The influence of delaying judgments of learning on metacognitive accuracy: A meta-analytic review. Psychological Bulletin, 137(1), 131–148. https://doi.org/10.1037/a0021705. ArticleGoogle Scholar
- Rivers, M. L., Dunlosky, J., & Joynes, R. (2019). The contribution of classroom exams to formative evaluation of concept-level knowledge. Contemporary Educational Psychology, 59, 101806. https://doi.org/10.1016/j.cedpsych.2019.101806. ArticleGoogle Scholar
- *Rodriguez, F., Kataoka, S., Rivas, M. J., Kadandale, P., Nili, A., & Warschauer, M. (2018). Do spacing and self-testing predict learning outcomes?. Active Learning in Higher Education, 1469787418774185. https://doi.org/10.1177/1469787418774185.
- *Rodriguez, F., Rivas, M. J., Matsumura, L. H., Warschauer, M., & Sato, B. K. (2018). How do students study in STEM courses? Findings from a light-touch intervention and its relevance for underrepresented students. PLoS One, 13(7). https://doi.org/10.1371/journal.pone.0200767.
- Roediger, H. L., Agarwal, P. K., McDaniel, M. A., & McDermott, K. B. (2011). Test-enhanced learning in the classroom: Long-term improvements from quizzing. Journal of Experimental Psychology: Applied, 17(4), 382–395. https://doi.org/10.1037/a0026252. ArticleGoogle Scholar
- Roediger, H. L., & Butler, A. C. (2011). The critical role of retrieval practice in long-term retention. Trends in Cognitive Sciences, 15(1), 20–27. https://doi.org/10.1016/j.tics.2010.09.003. ArticleGoogle Scholar
- Roediger, H. L., & Karpicke, J. D. (2006a). The power of testing memory: Basic research and implications for educational practice. Perspectives on Psychological Science, 1(3), 181–210. https://doi.org/10.1111/j.1745-6916.2006.00012.x. ArticleGoogle Scholar
- *Roediger, H. L., & Karpicke, J. D. (2006b). Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science, 17(3), 249–255. https://doi.org/10.1111/j.1467-9280.2006.01693.x. ArticleGoogle Scholar
- Roediger, H. L., Putnam, A. L., & Smith, M. A. (2011). Ten benefits of testing and their applications to educational practice. In Psychology of learning and motivation (Vol. 55, pp. 1–36). Cambridge: Academic Press. https://doi.org/10.1016/B978-0-12-387691-1.00001-6. ChapterGoogle Scholar
- Ross, B., Chase, A. M., Robbie, D., Oates, G., & Absalom, Y. (2018). Adaptive quizzes to increase motivation, engagement and learning outcomes in a first year accounting unit. International Journal of Educational Technology in Higher Education, 15(1), 30. https://doi.org/10.1186/s41239-018-0113-2. ArticleGoogle Scholar
- *Rovers, S. F., Stalmeijer, R. E., van Merriënboer, J. J., Savelberg, H. H., & de Bruin, A. B. (2018). How and why do students use learning strategies? A mixed methods study on learning strategies and desirable difficulties with effective strategy users. Frontiers in Psychology, 9, 2501. https://doi.org/10.3389/fpsyg.2018.02501. ArticleGoogle Scholar
- Rowland, C. A. (2014). The effect of testing versus restudy on retention: A meta-analytic review of the testing effect. Psychological Bulletin, 140(6), 1432–1463. https://doi.org/10.1037/a0037559. ArticleGoogle Scholar
- *Schmidmaier, R., Ebersbach, R., Schiller, M., Hege, I., Holzer, M., & Fischer, M. R. (2011). Using electronic flashcards to promote learning in medical students: Retesting versus restudying. Medical Education, 45(11), 1101–1110. https://doi.org/10.1111/j.1365-2923.2011.04043.x. ArticleGoogle Scholar
- Schraw, G., & Dennison, R. S. (1994). Assessing metacognitive awareness. Contemporary Educational Psychology, 19(4), 460–475. https://doi.org/10.1006/ceps.1994.1033. ArticleGoogle Scholar
- Schwieren, J., Barenberg, J., & Dutke, S. (2017). The testing effect in the psychology classroom: A meta-analytic perspective. Psychology Learning and Teaching, 16(2), 179–196. https://doi.org/10.1177/1475725717695149. ArticleGoogle Scholar
- *Senzaki, S., Hackathorn, J., Appleby, D. C., & Gurung, R. A. (2017). Reinventing flashcards to increase student learning. Psychology Learning and Teaching, 16(3), 353–368. https://doi.org/10.1177/1475725717719771. ArticleGoogle Scholar
- Shaughnessy, J. J., & Zechmeister, E. B. (1992). Memory-monitoring accuracy as influenced by the distribution of retrieval practice. Bulletin of the Psychonomic Society, 30(2), 125–128. https://doi.org/10.3758/BF03330416. ArticleGoogle Scholar
- *Sleight, D. A., & Mavis, B. E. (2006). Study skills and academic performance among second-year medical students in problem-based learning. Medical Education Online, 11(1), 4599. https://doi.org/10.3402/meo.v11i.4599. ArticleGoogle Scholar
- *Smith, M. A., Blunt, J. R., Whiffen, J. W., & Karpicke, J. D. (2016). Does providing prompts during retrieval practice improve learning?. Applied Cognitive Psychology, 30(4), 544–553. https://doi.org/10.1002/acp.3227. ArticleGoogle Scholar
- Smith, M. A., Roediger, H. L., & Karpicke, J. D. (2013). Covert retrieval practice benefits retention as much as overt retrieval practice. Journal of Experimental Psychology: Learning, Memory, and Cognition, 39(6), 1712–1725. https://doi.org/10.1037/a0033569. ArticleGoogle Scholar
- Soderstrom, N. C., & Bjork, R. A. (2014). Testing facilitates the regulation of subsequent study time. Journal of Memory and Language, 73, 99–115. https://doi.org/10.1016/j.jml.2014.03.003. ArticleGoogle Scholar
- Soderstrom, N. C., & Bjork, R. A. (2015). Learning versus performance: An integrative review. Perspectives on Psychological Science, 10(2), 176–199. https://doi.org/10.1177/1745691615569000. ArticleGoogle Scholar
- *Son, L. K. (2005). Metacognitive control: Children's short-term versus long-term study strategies. The Journal of General Psychology, 132(4), 347–364. https://doi.org/10.3200/GENP.132.4.347-364. ArticleGoogle Scholar
- *Steiner, H., Trivedi, N., & Brown, J. (2019). Bringing a learning strategies project to scale in a first-year seminar. Journal of Effective Teaching in Higher Education, 2(1), 27–44. ArticleGoogle Scholar
- Surma, T., Vanhoyweghen, K., Camp, G., & Kirschner, P. A. (2018). The coverage of distributed practice and retrieval practice in Flemish and Dutch teacher education textbooks. Teaching and Teacher Education, 74, 229–237. https://doi.org/10.1016/j.tate.2018.05.007. ArticleGoogle Scholar
- *Susser, J. A., & McCabe, J. (2013). From the lab to the dorm room: Metacognitive awareness and use of spaced study. Instructional Science, 41(2), 345–363. https://doi.org/10.1007/s11251-012-9231-8. ArticleGoogle Scholar
- Szpunar, K. K., Khan, N. Y., & Schacter, D. L. (2013). Interpolated memory tests reduce mind wandering and improve learning of online lectures. Proceedings of the National Academy of Sciences, 110(16), 6313–6317. https://doi.org/10.1073/pnas.1221764110. ArticleGoogle Scholar
- Thiede, K. W., Anderson, M. C. M., & Therriault, D. (2003). Accuracy of metacognitive monitoring affects learning of texts. Journal of Educational Psychology, 95(1), 66–73. https://doi.org/10.1037/0022-0663.95.1.66. ArticleGoogle Scholar
- Thiede, K. W., & Dunlosky, J. (1999). Toward a general model of self-regulated study: An analysis of selection of items for study and self-paced study time. Journal of Experimental Psychology: Learning, Memory, and Cognition, 25(4), 1024–1037. https://doi.org/10.1037/0278-7393.25.4.1024. ArticleGoogle Scholar
- *Thomas, R. C., Finn, B., & Jacoby, L. L. (2016). Prior experience shapes metacognitive judgments at the category level: The role of testing and category difficulty. Metacognition and Learning, 11(3), 257-.
- *Toppino, T. C., LaVan, M. H., & Iaconelli, R. T. (2018). Metacognitive control in self-regulated learning: Conditions affecting the choice of restudying versus retrieval practice. Memory & Cognition, 46(7), 1164–1177. https://doi.org/10.3758/s13421-018-0828-2. ArticleGoogle Scholar
- Tullis, J. G., & Benjamin, A. S. (2011). On the effectiveness of self-paced learning. Journal of Memory and Language, 64(2), 109–118. https://doi.org/10.1016/j.jml.2010.11.002. ArticleGoogle Scholar
- *Tullis, J. G., & Maddox, G. B. (2020). Self-reported use of retrieval practice varies across age and domain. Metacognition and Learninghttps://doi.org/10.1007/s11409-020-09223-x.
- *Tullis, J. G., Fiechter, J. L., & Benjamin, A. S. (2018). The efficacy of learners’ testing choices. Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(4), 540–552. https://doi.org/10.1037/xlm0000473. ArticleGoogle Scholar
- *Tullis, J. G., Finley, J. R., & Benjamin, A. S. (2013). Metacognition of the testing effect: Guiding learners to predict the benefits of retrieval. Memory & Cognition, 41(3), 429–442. https://doi.org/10.3758/s13421-012-0274-5. ArticleGoogle Scholar
- Trumbo, M. C., Leiting, K. A., McDaniel, M. A., & Hodge, G. K. (2016). Effects of reinforcement on test-enhanced learning in a large, diverse introductory college psychology course. Journal of Experimental Psychology: Applied, 22(2), 148–160. https://doi.org/10.1037/xap0000082. ArticleGoogle Scholar
- *Tse, C. S., Balota, D. A., & Roediger, H. L. (2010). The benefits and costs of repeated testing on the learning of face–name pairs in healthy older adults. Psychology and Aging, 25(4), 833–845. https://doi.org/10.1037/a0019933. ArticleGoogle Scholar
- Van Overschelde, J. P. (2008). Metacognition: Knowing about knowing. In J. Dunlosky & R. A. Bjork (Eds.), Handbook of metamemory and memory (pp. 47–71). Abington: Psychology Press. Google Scholar
- Van Overschelde, J. P., & Nelson, T. O. (2006). Delayed judgments of learning cause both a decrease in absolute accuracy (calibration) and an increase in relative accuracy (resolution). Memory & Cognition, 34(7), 1527–1538. https://doi.org/10.3758/BF03195916. ArticleGoogle Scholar
- *Vaughn, K. E. & Kornell, N. (2019). How to activate students’ natural desire to test themselves. Cognitive Research: Principles and Implications, 4(35). https://doi.org/10.1186/s41235-019-0187-y.
- Vaughn, K. E., & Rawson, K. A. (2011). Diagnosing criterion-level effects on memory: What aspects of memory are enhanced by repeated retrieval? Psychological Science, 22(9), 1127–1131. https://doi.org/10.1177/0956797611417724. ArticleGoogle Scholar
- *Velan, G. M., Jones, P., McNeil, H. P., & Kumar, R. K. (2008). Integrated online formative assessments in the biomedical sciences for medical students: Benefits for learning. BMC Medical Education, 8(1), 52. https://doi.org/10.1186/1472-6920-8-52. ArticleGoogle Scholar
- Weinstein, C. E., Schulte, A. C., & Hoy, A. W. (1987). LASSI: Learning and study strategies inventory. Clearwater: H & H Publishing Company. Google Scholar
- Winne, P. H., & Hadwin, A. F. (1998). Studying as self-regulated learning. In D. J. Hacker, J. Dunlosky, & A. Graesser (Eds.), Metacognition in educational theory and practice (pp. 277–304). Mahwah: Erlbaum. Google Scholar
- Winne, P. H., & Jamieson-Noel, D. (2002). Exploring students’ calibration of self reports about study tactics and achievement. Contemporary Educational Psychology, 27(4), 551–572. https://doi.org/10.1016/S0361-476X(02)00006-1. ArticleGoogle Scholar
- *Wissman, K. T., Rawson, K. A., & Pyc, M. A. (2012). How and when do students use flashcards?. Memory, 20(6), 568–579. https://doi.org/10.1080/09658211.2012.687052. ArticleGoogle Scholar
- *Wissman, K. T., & Rawson, K. A. (2016). How do students implement collaborative testing in real-world contexts?. Memory, 24(2), 223–239. https://doi.org/10.1080/09658211.2014.999792. ArticleGoogle Scholar
- *Wood, E., Motz, M., & Willoughby, T. (1998). Examining students’ retrospective memories of strategy development. Journal of Educational Psychology, 90(4), 698. https://doi.org/10.1037/0022-0663.90.4.698. ArticleGoogle Scholar
- Wooldridge, C. L., Bugg, J. M., McDaniel, M. A., & Liu, Y. (2014). The testing effect with authentic educational materials: A cautionary note. Journal of Applied Research in Memory and Cognition, 3(3), 214–221. https://doi.org/10.1016/j.jarmac.2014.07.001. ArticleGoogle Scholar
- Yan, V. X., Bjork, E. L., & Bjork, R. A. (2016). On the difficulty of mending metacognitive illusions: A priori theories, fluency effects, and misattributions of the interleaving benefit. Journal of Experimental Psychology: General, 145(7), 918–933. https://doi.org/10.1037/xge0000177. ArticleGoogle Scholar
- *Yan, V. X., Thai, K. P., & Bjork, R. A. (2014). Habits and beliefs that guide self-regulated learning: Do they vary with mindset?. Journal of Applied Research in Memory and Cognition, 3(3), 140–152. https://doi.org/10.1016/j.jarmac.2014.04.003. ArticleGoogle Scholar
- Yang, C., Potts, R., & Shanks, D. R. (2017). Metacognitive unawareness of the errorful generation benefit and its effects on self-regulated learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 43(7), 1073–1092. https://doi.org/10.1037/xlm0000363. ArticleGoogle Scholar
- *Ye, L., Oueini, R., Dickerson, A. P., & Lewis, S. E. (2015). Learning beyond the classroom: Using text messages to measure general chemistry students' study habits. Chemistry Education Research and Practice, 16(4), 869–878. https://doi.org/10.1039/C5RP00100E. ArticleGoogle Scholar
- *Yeo, D. J., & Fazio, L. K. (2019). The optimal learning strategy depends on learning goals and processes: Retrieval practice versus worked examples. Journal of Educational Psychology, 111(1), 73–90. https://doi.org/10.1037/edu0000268.
- *Yong, P. Z., & Lim, S. W. H. (2016). Observing the testing effect using Coursera video-recorded lectures: A preliminary study. Frontiers in Psychology, 6, 2064. https://doi.org/10.3389/fpsyg.2015.02064. ArticleGoogle Scholar
- Wasylkiw, L., Tomes, J. L., & Smith, F. (2008). Subset testing: Prevalence and implications for study behaviors. The Journal of Experimental Education, 76(3), 243–257. https://doi.org/10.3200/JEXE.76.3.243-258. ArticleGoogle Scholar
- *Weissgerber, S. C., & Reinhard, M. A. (2018). Pilot study on the relationship of test anxiety to utilizing self-testing in self-regulated learning. International Journal of Psychological Studies, 10(4). https://doi.org/10.5539/ijps.v10n4p95.
- *Weissgerber, S. C., Reinhard, M. A., & Schindler, S. (2018). Learning the hard way: Need for cognition influences attitudes toward and self-reported use of desirable difficulties. Educational Psychology, 38(2), 176–202. https://doi.org/10.1080/01443410.2017.1387644. ArticleGoogle Scholar
- Zawadzka, K., & Hanczakowski, M. (2019). Two routes to memory benefits of guessing. Journal of Experimental Psychology: Learning, Memory, and Cognition, 45(10), 1748–1760. https://doi.org/10.1037/xlm0000676. ArticleGoogle Scholar
- Zimmerman, B. J. (2008). Investigating self-regulation and motivation: Historical background, methodological developments, and future prospects. American Educational Research Journal, 45(1), 166–183. https://doi.org/10.3102/0002831207312909. ArticleGoogle Scholar
Acknowledgments
The author gratefully acknowledges John Dunlosky, Katherine A. Rawson, Steven C. Pan, Sabrina Badali, and Clarissa A. Thompson for their support and helpful suggestions on earlier versions of this manuscript.