JUDGING THE JUDGES: EXAMINING SUPERVISORS ASSESSMENT OF UNOBSERVABLE SKILLS IN DEVELOPED EFL TEACHING PRACTICE MODEL
DOI:
https://doi.org/10.46827/ejes.v0i0.2910Keywords:
teachers training, EFL teaching practice, assessment criteria, skills assessmentAbstract
This qualitative descriptive case study reflects the researcher's experience, as a Teaching Practice (TP) Co-ordinator at the Libyan Faculty of Education Tripoli (FET), in developing and examining academic supervisors’ implementation of an innovative TP Assessment Model for EFL trainees. Previous assessment lacked accuracy and comprehensiveness and relied solely on assessing behavioural observable skills. The new TPAM incorporates, for the first time at FET, Unobservable Skills Assessment through supporting documents that supervisors use to assess trainees’ skills in classroom observation, feedback provision, self-reflection, and reporting on TP experience, all of which comprise a Teaching Practice Portfolio (TPP). The study focuses on a key concern: (1) How to develop existing assessment criteria in an objective and comprehensive manner embracing both observable and unobservable skills. Two operational sub-questions emerged: (2) How would the supervisors’ implement the Unobservable Skills Assessment in the TPAM; (3) How would trainees respond to Unobservable Skills Assessment criteria? Data were collected through quantitative analysis of the supporting documents; semi-structured interviews with seven supervisors involved; focus group discussions with trainee teachers. The findings show that while the supervisors were satisfied with the developed assessment criteria, their overall performance in implementing the Unobservable Skills Assessment was poor; besides a lack of immediate feedback provision after school visits, the supporting documents for unobservable skills were not fully executed. Only two supervisors out of seven demonstrated acceptable adherence to the model requirements. Some trainees had reservations regarding the extra workload required in carrying out self-reflections and in writing reports of TP experience; others considered the criterion of professional development outlook inconsequential during initial teacher training.
References
Al-Faqi A. F. (1994). Arabic. School Management, 1st Edition. Benghazi: University of Benghazi Publications, Libya.
Al-Rantisi, M. M. (2010). Arabic. Student Teacher Assessment of Class Activities and its Relationship with some Variables, Islamic University Journal (Humanities Studies Series), 18 (1) 83-104. Retrieved from: https://journals.iugaza.edu.ps/index.php/IUGJHR/article/view/886/828.
Al-Zamli A. J (1990). Arabic. Faculty of Education between Arts and Science, University Magazine, 56, Baghdad, Iraq.
Baserah, E. A. (2015). Arabic. Teaching Competencies of Student Teachers of English as Reflected in Class Performance at this Stage, Al-Andalus Journal for Humanity and Social Sciences, 7(11).
Borg, S. (2003). Teacher Cognition in Language Teaching: A review of research on what language teachers think, know, believe, and do. Language Teaching 36 (2).
Bright, A. (n.d). ESL/bilingual Endorsement Program Practicum Handbook, Graduate School of Education, Portland State University. Retrieved from: https://www.pdx.edu/ceed/sites/www.pdx.edu.ceed/files/esol_practicum_handbook.pdf.
Darling-Hammond, L. (1990). Teacher Evaluation in Transition: Emerging Roles and Evolving Methods. In J. Millman & L. Darling Hammond (eds.), The New Handbook of Teacher Evaluation: Assessing Elementary and Secondary School Teachers (pp. 17–32). Newbury Park: Sage Publications.
DeLuca, C., LaPointe-McEwan, D. & Luhanga, U. (2016). Teacher Assessment Literacy: A review of international standards and measures. Educational Assessment, Evaluation and Accountability, 28(3), 251-272. Retrieved from: http://eric.ed.gov/?id=EJ1112727.
Elmabruk, R. (2014). Enhancing Continuous Professional Development for Libyan In-service EFL Teachers: A conceptual framework, Journal of the Faculty of Education Tripoli, vol.9. Retrieved from: https://www.researchgate.net/publication/327573282_Enhancing_Continuous_Professional_Development_for_Libyan_In-service_EFL_Teachers_A_conceptual_framework.
Elmabruk, R. (2018). Teaching Practice Guide: A guide to teaching practice procedure and assessment for trainee teachers and supervisors, Faculty of Education Tripoli, The University of Tripoli, Libya. Retrieved from: https://www.researchgate.net/publication/334108206_Teaching_Practice_Guide_A_guide_to_teaching_practice_procedure_and_assessment_for_trainee_teachersand_supervisor.s
ESOL Practicum Handbook (2017). School of Education TESOL Practicum Handbook, Handbook for Teacher Education Candidates, Clinical Supervisors and University Supervisors, Kansas University. Retrieved from: https://soe.ku.edu/sites/soe.ku.edu/files/docs/fieldexp/C%26T%20491%20TESOL%20Practicum%20Handbook%20%28Fall%202017%29.pdf.
Genc, B. and Buyukkarci, K. (2013). An Assessment of Pre-service Language Teachers’ Practicum Observation Forms: Descriptive observation vs. critical observation, Educational Research, 2 (2). Retrieved from: https://rua.ua.es/dspace/bitstream/10045/29129/1/EREJ_02_02_01.pdf
Goldrick, L. (2002). December 9. Improving Teacher Evaluation to Improve Teacher Quality (Issue Brief). Washington D.C.: National Governors Association. Retrieved from: https://files.eric.ed.gov/fulltext/ED480159.pdf
Guttentag, H. (2016). Practicum Handbook, Simmons College Department of Education Initial License Practicum Handbook, Simmons College. Boston, Massachusetts. Retrieved from: http://www2.simmons.edu/documents/academics/education/MAT-Practicum-Handbook.pdf.
Hall, P. (2017). Practicum Handbook, Education Department, Westfield State University. Retrieved from: http://www.westfield.ma.edu/images/uploads/music/wsupracticumhandbook2018.pdf.
Libyan Organization for Policy and Strategies (2016). Arabic. Education in Libya- Obstacles, challenges and solutions. Retrieved from: http://loopsresearch.org/media/images/photofmkdgao2jn.pdf.
Mahfoud, A. F. (2016). Modern Directions in Assessing Teacher Performance, Education and Training. Retrieved from: https://www.facebook.com/ben25mohamed/posts/769642323179416/.
Nasr, H. (2003). Effectiveness of Teaching Practice for the Specialization Teacher in the Faculty of Education Ibri from the Point of View of Supervisors and Female Student Teachers and Cooperating School Principals. Educational Journal, 17 (68). University of Kuwait: Scientific Publishing Council.
Richards, J. C. and Lockhart, C. (1996). Reflective Teaching in Second Language Classrooms. Cambridge: Cambridge University Press.
Ryan, J. M., & Kuhs, T. M. (1993). Assessment of Pre-service Teachers and the Use of Portfolios: Theory into Practice, 32(2), 75-81. Retrieved from: http://dx.doi.org/10.1080/00405849309543578.
Shannon, D. M. (1994). An Evaluation Approach for the Development of Pre-service Teachers. Paper presented at the Annual Meeting of CREATE (Centre for Research on Educational Accountability and Teacher Evaluation) National Evaluation Institute, 3rd, Gatlinburg, TN, July 10-15.
Sharma, T. N. (2009). Internship handbook, School of Education, Kathmandu University. Balkumari, Nepal.
Sopheakdei, M. (2014). Practicum portfolio: A senior report presented to the Faculty of Education, University of Cambodia, Cambodia. Retrieved from: https://www.academia.edu/6883528/Practicum_Portfolio.
Syamsudarni, S. & Sahraini, S. (2018). An Evaluation Model of Teaching Practicum of Pre-Service EFL Teachers at the Faculty of Education and Teacher Training in Higher Education, Arab World English Journal (AWEJ), 9(2). Retrieved from: https://ssrn.com/abstract=3201963 or http://dx.doi.org/10.2139/ssrn.3201963.
Thornbbury, S. and Watkins, P. (2007). The CELTA Certificate in English Language Teaching to Adults, published in collaboration with Cambridge ESOL, Cambridge: CUP.
To’ma, T. (2014). Education Development: From goals to competencies and Criteria. The national workshop on curriculum requirements according to criteria entry, 14-16 October, Damascus. Retrieved from: http://new.damascusuniversity.edu.sy/faculties/edu/images/stories/news/wl.pdf
Zamel, M. (2013) Arabic. Assessing Performance Assessment Forms of Student Teachers of the Practicum Programme in Education at Al-Quds Open University, Palestine Journal of Open Learning, 4(7). Retrieved from: https://dspace.qou.edu/bitstream/194/1183/1/338-1315-1-PB.pdf.
Downloads
Published
Issue
Section
License
Authors who publish with this journal agree to the following terms:
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).


