PROPOSING A METHOD TO CREATE METACOGNITIVE SCHOOL EXAMS
DOI:
https://doi.org/10.46827/ejes.v0i0.2153Keywords:
metacognition, educational assessment, methodology, school exams.Abstract
Metacognition is defined as the capacity of the persons to monitor, to regulate and to construct knowledge about their inner processes. Theoretically, this construct is relevant to Education and correlated areas, since the process of learning and knowledge construction involves metacognition. Besides, there are evidences that certain metacognitive components are predictors of academic achievement of the students. Regarding these aspects, this paper proposes a methodology that permits educators to elaborate metacognitive school exams, which are capable of measuring both the students' knowledge of an educational domain (i.e., concepts pertaining to biology, chemistry, history, mathematics, physics, and so on), and the following metacognitive abilities: feeling-of-knowing, monitoring (detection of errors), self-management, and judgment. In this paper, we present the methodology stressing on the steps that enable the teacher to elaborate a school exam capable of measuring a target educational domain, as well as the stated metacognitive abilities. Concomitantly, we apply this methodology, showing the construction of the Metacognitive School Exam in Electrostatics.
Article visualizations:
References
Andretta, I.; Silva, J. G.; Susin, N.; & Freire, S. D. (2010). Metacognição e aprendizagem: como se relacionam? Psico, Porto Alegre, PUCRS, 41(1), pp. 7-13.
Beaujean, A. A. (2013) Factor Analysis Using R. Practical Assessment, Research & Evaluation, Vol 18, No 4 Page 2. https://pareonline.net/pdf/v18n4.pdf
Busnello, F. B., Jou, G. I. & Sperb, T. M. (2012). Desenvolvimento de habilidades metacognitivas: capacitação de professores de ensino fundamental. Psicologia: Reflexão e Crítica,.25(2), 311-319. http://www.scielo.br/pdf/prc/v25n2/a13v25n2.pdf
Byrne, B. M. (1998). Multivariate applications book series. Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. Mahwah, NJ, US: Lawrence Erlbaum Associates Publishers.
Costa, C. J. B. (2013). Sucesso escolar no ensino secundário-Autorregulação e performances de aprendizagem em busca do sucesso (Tese de doutoramento em Ciências da Educação). Universidade de Coimbra, Portugal. https://estudogeral.sib.uc.pt/bitstream/10316/24218/3/Sucesso%20escolar%20no% 20ensino%20secundario.pdf
Dunning, D., Johnson, K., Ehrlinger, J., & Kruger, J. (2003). Why people fail to recognize their own incompetence. Current Directions in Psychological Science, 12(3), 83-87 https://doi.org/10.1111/1467-8721.01235
Efklides, A. (2006). Metacognition and affect: What can metacognitive experiences tell us about the learning process? Educational Research Review, 1 (1), 3-14. doi:10.1016/j.edurev.2005.11.001
Flavell, J. H. (1976). Metacognitive aspects of problem solving. In L. B. Resnick (Ed.), The nature of intelligence (pp.231-236). Hillsdale, NJ: Erlbaum
Flavell, J. H. (1979). Metacognition and cognitive monitoring: A new area of cognitive– developmental inquiry. American Psychologist, 34(10), 906-911. http://dx.doi.org/10.1037/0003-066X.34.10.906
Fleming, S. M., Massoni, S., Gajdos, T. & Vergnaud, J. C. (2016). Metacognition about the past and future: quantifying common and distinct influences on prospective and retrospective judgments of self-performance. Neuroscience of Consciousness, 2016(1) 1–12 doi: 10.1093/nc/niw018
Fox, J. P., Maarten, M., Mulder, J. & Verhagen, J. (2016). Complex Latent Variable Modeling in Educational Assessment. Communications in Statistic - Simulation and Computation, 45(5): 1499–1510, DOI: 10.1080/03610918.2014.939518
Frey, A., Seitz, N. N., & Brandt, S. (2016). Testlet-Based Multidimensional Adaptive Testing. Frontiers in Psychology, 7, 1758. http://doi.org/10.3389/fpsyg.2016.01758
Garret, J., Alman, M., Gardner, S., & Born, C. (2007). Assessing students' metacognitive skills. American Journal of Pharmaceutical Education, 71(1), 1-7. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1847545/pdf/ajpe14.pdf
Gomes, C. M. A., & Golino, H. F. (2014). Self-reports on students' learning processes are academic metacognitive knowledge. Psicologia Reflexão e Crítica, 27 (3), 433-441. DOI: 10.1590/1678-7153.201427307
Gomes, C. M. A., Hudson F. Golino, H. F., & Menezes, I. G. (2014). Predicting School Achievement Rather than Intelligence: Does Metacognition Matter? Psychology, 5, 1095-1110. DOI: 10.4236/psych.2014.59122
Gomes, C. M. A., Almeida, L. S. & Núñez, J. C. (2017). Rationale and Applicability of Exploratory Structural Equation Modeling (ESEM) in Psychoeducational Contexts. Psicothema, 29(3), 396-401. doi: 10.7334/psicothema2016.369
Gonçalves, J. & Martins, M. A. (2013) Avaliação Da Metacognição, Autorregulação Eutilização De Estratégias Cognitivas Em Atividades De Investigação. Atas do XII Congresso Internacional Galego-Português de Psicopedagogia. Braga: Universidade do Minho, pp 4153-4165
Hart, J. T. (1965). Memory and the feeling-of-knowing experience. Journal of Educational Psychology, 56(4), 208-216. http://dx.doi.org/10.1037/h0022263
Hart, J. T. (1967). Memory and the memory-monitoring process. Journal of Verbal Learning & Verbal Behavior, 6(5), 685-691. http://dx.doi.org/10.1016/S0022- 5371(67)80072-0
Heale, R. & Twycross, A. (2015). Validity and reliability in quantitative studies. Evidence-Based Nursing 18(3):66-67 http://dx.doi.org/10.1136/eb-2015-102129
Hertzog, C., Dunlosky, J. & Sinclair, S. M. (2010). Memory & Cognition, 38(6): 771-784. https://doi.org/10.3758/MC.38.6.771
Hirschfeld, G. & von Brachel, R. (2014) Multiple-group confirmatory factor analysis. Practical Assessment, Research & Evaluation, Vol 19, No 7 Page 2 https://pareonline.net/getvn.asp?v=19&n=7
Hood, S. B. (2009). Validity and reliability in quantitative studies. Evidence-Based Nursing 18(3), 66-67 doi: 10.1136/eb-2015-102129
Lai, E. R. (2011). Metacognition: A literature review. Pearson research reports. New York, NY. http://www.pearsonassessments.com/hai/images/tmrs/metacognition_Literature _Review_Final.pdf
LaMarca, A. (2014). The development of a questionnaire on metacognition for students in secondary school. In Proceedings of EDULEARN14 Conference 7th-9th July 2014 (pp. 676-691). Barcelona: IATED.
Lawanto, O. (2010). Students' metacognition during an engineering design project. Performance Improvement Quarterly, 23(2), 117-136. https://doi.org/10.1002/piq.20084
Lee, G., Brennan, R. L., & Frisbie, D. A. (2001). Incorporating the testlet concept in test score analyses. Educational Measurement: Issues and Practice, 19(4), 5-9.
Loehlin, J. C. (2004). Latent variable models: An introduction to factor, path, and structural equation analysis. 4. Ed. Mahwah, NJ: Lawrence Erlbaum.
Luz, A. M. R., Alvares, B. A. (2011a). Física − Contexto e Aplicações Volume - 3. (1ª ed). São Paulo: Scipione.
Metcalfe, J., Schwartz, B. L., & Joaquim, S. G. (1993). The cue-familiarity heuristic in metacognition. Journal of Experimental Psychology: Learning, Memory, and Cognition, 19(4), 851-861. http://dx.doi.org/10.1037/0278-7393.19.4.851
Metcalfe, J., Dunlosky, J., (2008). Metamemory. In Learning and Memory: A Comprehensive Reference -Vol 2- Elsevier. Pages 349-362 http://www.columbia.edu/cu/psychology/metcalfe/PDFs/Metcalfe%202008.pdf
Metcalfe, J. (1986). Feeling-of-knowing in memory and problem solving. Journal of Experimental Psychology: Learning, Memory, and Cognition, 12(2), 288-294. http://dx.doi.org/10.1037/0278-7393.12.2.288
Nelson, T. O., & Narens, L. (1996). Why investigate Metacognition? In J. Metcalfe & A. P. Shimamura (Ed.), Metacognition. Knowing about knowing (pp. 1-27). Cambridge, MA: MIT Press.
http://www.imbs.uci.edu/~lnarens/1994/Nelson&Narens_Book%20Chapter_1994.p
Nelson, T. O., & Narens, L. (1980). Norms of 300 general-information questions: Accuracy of recall, latency of recall, and felling-of-knowing ratings. Journal of Verbal Learning and Verbal Behavior, 19, 338–368. doi: 10.1016/S0022-5371(80)90266- 2
Nelson, T. O., & Narens, L. (1994). Why investigate metacognition. In J. Metcalfe, & A. P. Shimamura (Eds.), Metacognition: Knowing about knowing (pp. 1-25). Cambridge, MA: MIT Press.
Paris, S. G., & Winograd, P. (1990). Metacognition in academic learning and instruction. In B. F. Jones (Ed.), Dimension of thinking and Cognitive Instruction. Hillsdale, NJ: Erlbaum.
Pires, A. A. M., & Gomes, C. M. A. (2017). Três procedimentos equivocados na elaboração de provas escolares: Explicitação e discussão. Ponte International Scientific Journal, 73(3), 2-14. doi: http://dx.doi.org/10.21506/j.ponte.2017.3.1,
Roebers, C. M., Krebs, S. S., & Roderer, T. (2014). Metacognitive monitoring and control in elementary school children: Their interrelations and their role for test performance. Learning and Individual Differences, 29, 141–149. https://doi.org/10.1016/j.lindif.2012.12.003
Schneider, W. (2010). The Development of Metacognitive Competences. In: H. Salatas Waters and W. Schneider (Eds.) (2010), Metacognition, Strategy Use, and Instruction. New York: Guilford Press.203-214. DOI: 10.1007/978-3-642-03129- 8_14
Schraw, G. (1997). The Effect of Generalized Metacognitive Knowledge on Test Performance and Confidence Judgments. The Journal of Experimental Education, 65(2), 135-146. DOI: 10.1080/00220973.1997.9943788
Schraw, G (1998). Promoting general metacognitive awareness. Instructional Science, 26(1-2), 113–125. https://doi.org/10.1023/A:1003044231033
Schraw, G. (2008). A conceptual analysis of five measures of metacognitive monitoring. Metacognition and Learning, 4(1), 33-45. doi:10.1007/s11409-008-9031-3.
Schraw, G., Crippen., K. J., & Hartley, K. (2006). Promoting Self-Regulation in Science Education: Meatacognition as Part of a Broader Perspective on Learning. Research in Science Education, 36(1-2), 111-139. DOI: 10.1007/s11165-005-3917-8
Sternberg, R. (2000). Psicologia cognitiva. Porto Alegre, RS: Artes Médicas.
Stewart, P. W., Cooper, S. S., & Moulding, L. R. (2007). Metacognitive development in professional educators. The Researcher, 21(1), 32−40.
Tanikawa, H. A.M. & Boruchovitch, E. (2016). Monitoramento Metacognitivo de alunos do ensino fundamental Psicologia Escolar e Educacional, SP. Volume 20, Número 3, pp 457-464.
http://dx.doi.org/10.1590/2175-3539/2015/02031012
Thiede, K. W., & Anderson, M. C. M. (2003). Summarizing can improve metacomprehension accuracy. Contemporary Educational Psychology, 28(xxx), 129- 160.
Thomas, A. K., Bulevich, J. B., Dubois, S. J. (2012). An analysis of the determinants of the feeling-of-knowing. Consciousness and Cognition 21(4), 1681–1694. https://doi.org/10.1016/j.concog.2012.09.005
Urbina, S. (2014). Essentials of psychological testing (2nd ed.). Hoboken: Wiley.
Veenman, M. V. J. (2011). Alternative assessment of strategy use with self-report instruments: a discussion. Metacognition and Learning, 6(2), pp 205–211. https://doi.org/10.1007/s11409-011-9080-x
Veenman, M. V. J. & Verheij, J. (2003). Technical students’ metacognitive skills: Relating general vs. specific metacognitive skills to study success. Learning and Individual Differences, 13, pp. 259-272.
Veenman, M. V. J.; Wilhelm, P., & Beishuizen, J. J. (2004). The relation between intellectual and metacognitive skills from a developmental perspective. Learning and Instruction, 14, pp. 89-109.
Wainer, H., & Kiely, G. L. (1987). Item clusters and computerized adaptive testing: A case for testlets. Journal of Educational Measurement, 24(3), 185-201. http://dx.doi.org/10.1111/j.1745-3984.1987.tb00274.x
Wirth, R. J., Edwards M. C. (2007). Psychol Methods. 12(1): 58–79. doi:10.1037/1082- 989X.12.1.58.
Wixson, K. K. (1983). Postreading question–answer interactions and children's learning from text. Journal of Educational Psychology, 75(3), 413-423. http://dx.doi.org/10.1037/0022-0663.75.3.413
Yeung, N. & Summerfield, C. (2012). Metacognition in human decision-making: confidence and error monitoring. Philosophical Transactions Royal Society, 367(1594), 1310–1321 doi:10.1098/rstb.2011.0416
Yong, A. G., & Pearce, S. (2013). A beginner’s guide to factor analysis: Focusing on exploratory factor analysis. Tutorials in Quantitative Methods for Psychology, 9(2), 79-94. doi: 10.20982/tqmp.09.2.p079
Downloads
Published
Issue
Section
License
Authors who publish with this journal agree to the following terms:
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
