Pertanika Journal of Social Sciences & Humanities
Pertanika Journal Home Facebook
Pertanika · Universiti Putra Malaysia Press

Pertanika Journal of Social Sciences & Humanities

Official journal of Universiti Putra Malaysia for scholarly work across the social sciences, humanities and related interdisciplinary fields.

e-ISSN 2231-8534 ISSN 0128-7702
Research article

Identification of Constructs and Subconstructs of Teacher Classroom Assessment Literacy Instrument

Nor Hafizi Mohd Khalid, Adibah Abdul Latif, Megat Aman Zahiri Megat Zakaria, Ibnatul Jalilah Yusof and Md Daud Md Jani

https://doi.org/10.47836/pjssh.31.2.11
KeywordsAssessment literacy, classroom assessment, instruments, primary school teachers
Article content

Abstract

This study was conducted to identify constructs and subconstructs of teacher classroom assessment literacy instrument. Qualitative document analysis was conducted to identify the constructs and subconstructs used. This document covers previous research articles, modules, and standard documents used in conducting classroom assessments. The qualitative data are analyzed using the literature review system model with four thematic analysis phases. Four main themes or constructs of classroom assessment literacy are derived from the document analysis: Purpose, Measurement, Evaluation, and Use. These four themes are used as the basis for analyzing the Classroom Assessment Standard and Classroom Assessment Implementation Guide from the Ministry of Education Malaysia as the main reference of the study. Besides, four 21st-century assessment features, nine classroom assessment features, and five features of high-order thinking skills items are also included in the analysis as an added value in the constructs and subconstructs. Based on the analysis, three subconstructs for the purpose component, seven for the measurement component, four for the assessment component, and five for the usage component are identified. All these findings are incorporated into the teacher’s assessment literacy instrument.
Supporting literature

References

  1. American Federation of Teachers, National Council on Measurement in Education, & National Education Association. (1990). Standards for Teacher Competence in Educational Assessment of Students. Educational Measurement: Issues and Practice, 9(4), 30. https://doi.org/10.1111/j.1745-3992.1990.tb00391.x
  2. Ashraf, H., & Zolfaghari, S. (2018). EFL teachers’ assessment literacy and their reflective teaching. International Journal of Instruction, 11(1), 425-436. https://doi.org/10.12973/iji.2018.11129a
  3. Bowen, G. A. (2009). Document analysis as a qualitative research method. Qualitative Research Journal, 9(2), 27-40. https://doi.org/10.3316/QRJ0902027
  4. Burns, N., & Grove, S. K. (1993). The practice of nursing research conduct,critique, and utilization (3rd ed.). WB Saunders Company.
  5. Chappius, J., Stinggins, R. J., Chappius, S., & Arter, J. A. (2012). Classroom assessment for student learning: Doing it right-using it well. (2nd ed.). Assessment Training Institute Inc.
  6. Coombe, C., Vafadar, H., & Mohebbi, H. (2020). Language assessment literacy: What do we need to learn, unlearn, and relearn? Language Testing in Asia, 10, Article 3. https://doi.org/10.1186/s40468-020-00101-6
  7. Corbin, J., & Strauss, A. (2008). Basics of qualitative research: Techniques and procedures for developing grounded theory (3rd ed.). SAGE Publications Inc. https://doi.org/10.4135/9781452230153
  8. Curriculum Development Division. (2014). Elemen KBAT dalam pentaksiran [HOTS elements in assessment]. Malaysia of Education Ministry.
  9. Curriculum Development Division. (2019). Panduan perlaksanaan pentaksiran bilik darjah (2nd ed.) [Classroom assessment implementation guide]. Malaysia of Education Ministry.
  10. DeCarlo, M. (2018). Scientific inquiry in social work. Open Social Work Education.
  11. DeLuca, C., & Bellara, A. (2013). The current state of assessment education: Aligning policy, standards, and teacher education curriculum. Journal of Teacher Education, 64(4), 356-372. https://doi.org/10.1177/0022487113488144
  12. DeLuca, C., Coombs, A., & LaPointe-McEwan, D. (2019). Assessment mindset: Exploring the relationship between teacher mindset and approaches to classroom assessment. Studies in Educational Evaluation, 61, 159-169. https://doi.org/10.1016/j.stueduc.2019.03.012
  13. DeLuca, C., LaPointe-McEwan, D., & Luhanga, U. (2015). Teacher assessment literacy: A review of international standards and measures. Educational Assessment, Evaluation and Accountability, 28(3), 251-272. https://doi.org/10.1007/s11092-015-9233-6
  14. DeLuca, C., LaPointe-McEwan, D., & Luhanga, U. (2016). Approaches to classroom assessment inventory: A new instrument to support teacher assessment literacy. Educational Assessment, 21(4), 248-266. https://doi.org/10.1080/10627197.2016.1236677
  15. Edwards, F. (2020). The effect of the lens of the teacher on summative assessment decision making: The role of amplifiers and filters. Curriculum Journal, 31(3), 379-397. https://doi.org/10.1002/curj.4
  16. Gioia, D. A., Corley, K. G., & Hamilton, A. L. (2013). Seeking qualitative rigor in inductive research: Notes on the Gioia Methodology. Organizational Research Methods, 16(1), 15-31. https://doi.org/10.1177/1094428112452151
  17. Gotch, C. M., & French, B. F. (2014). A systematic review of assessment literacy measures. Educational Measurement: Issues and Practice, 33(2), 14-18. https://doi.org/10.1111/emip.12030
  18. Gray, J. R., Grove, S. K., & Sutherland, S. (2017). The practice of nursing research: Appraisal, synthesis, and generation of evidence (8th ed.). Elsevier.
  19. Guest, G., Bunce, A., & Johnson, L. (2006). How many interviews are enough?: An experiment with data saturation and variability. Field Methods, 18(1), 59-82. https://doi.org/10.1177/1525822X05279903
  20. Hawkins, M., Elsworth, G. R., Hoban, E., & Osborne, R. H. (2020). Questionnaire validation practice within a theoretical framework: A systematic descriptive literature review of health literacy assessments. BMJ Open, 10(6), Article e035974. https://doi.org/10.1136/bmjopen-2019-035974
  21. Jan-nesar, M. Q., Khodabakhshzadeh, H., & Motallebzadeh, K. (2020). Assessment literacy of Iranian EFL teachers: A review of recent studies. Journal of Asia TEFL, 17(2), 689-698. https://doi.org/http://dx.doi.org/10.18823/asiatefl.2020.17.2.27.689
  22. Jawhar, S. S., & Subahi, A. M. (2020). The impact of specialty, sex, qualification, and experience on teachers’ assessment literacy at Saudi higher education. International Journal of Learning, Teaching and Educational Research, 19(5), 200-216. https://doi.org/10.26803/ijlter.19.5.12
  23. Jing, H., & Zonghui, H. E. (2016). Exploring assessment literacy. Higher Education of Social Science, 11(2), 18-27.
  24. Kline, T. J. B. (2015). Psychological testing: A practical approach to design and evaluation. SAGE Publications Inc.
  25. Klinger, D., McDivitt, P. J., Howard, B. B., Munoz, M. A., Roger, W. T., & Wylie, E. C. (2015). The Classroom Assessment Standards for PreK-12 Teachers. Kindle Direct Press.
  26. Labuschagne, A. (2003). The qualitative report qualitative research -airy fairy or fundamental? The Qualitative Report, 8(1), 100-103. https://doi.org/https://doi.org/10.46743/2160-3715/2003.1901
  27. Levy-Vered, A., & Alhija, F. N.-A. (2015). Modelling beginning teachers’ assessment literacy: the contribution of training, self-efficacy, and conceptions of assessment. Educational Research and Evaluation, 21(5-6), 378-406. https://doi.org/10.1080/13803611.2015.1117980
  28. Lian, L. H., Yew, W. T., & Meng, C. C. (2014). Enhancing Malaysian teachers’ assessment literacy. International Education Studies, 7(10), 74-81. https://doi.org/10.5539/ies.v7n10p74
  29. Linneberg, M. S., & Korsgaard, S. (2019). Coding qualitative data: A synthesis guiding the novice. Qualitative Research Journal, 19(3), 259-270. https://doi.org/10.1108/QRJ-12-2018-0012
  30. McMillan, J. H. (2011). Classroom assessment: Principles and practice for effective standards-based instruction. Pearson.
  31. Md Said, M. D. (2018). Kompilasi panduan perlaksanaan PdPc PAK21 (Ke-2) [Compilation of teaching and learning 21st century implementation guide (2nd)]. Penerbit UTHM.
  32. Mellati, M., & Khademi, M. (2018). Exploring teachers’ assessment literacy: Impact on learners’ writing achievements and implications for teacher development. Australian Journal of Teacher Education, 43(6), 1-18. https://doi.org/10.14221/ajte.2018v43n6.1
  33. Mertler, C. A. (2003, October 15-18). Preservice versus inservice teachers’ assessment literacy: Does classroom experience make a difference? [Paper presentation]. Annual Meeting of the Mid-Western Educational Research Association, Ohio, United States. https://eric.ed.gov/?id=ED482277
  34. Messick, S. (1989). Meaning and values in test validation: The science and ethics of assessment. Educational Researcher, 18(2), 5-11. https://doi.org/10.3102/0013189X018002005
  35. Morse, J. M., Barrett, M., Mayan, M., Olson, K., & Spiers, J. (2002). Verification strategies for establishing reliability and validity in qualitative research. International Journal of Qualitative Methods, 1(2), 13-22. https://doi.org/10.1177/160940690200100202
  36. Muchtar, H. K., Nahadi, & Hernani. (2020). Evaluation of chemical literacy assessment instruments in solution materials. Journal of Physics: Conference Series, 1521(4). https://doi.org/10.1088/1742-6596/1521/4/042061
  37. Muhammad, F. H. N., & Bardakci, M. (2019). Iraqi EFL teachers’ assessment literacy: Perceptions and practices. Arab World English Journal, 10(2), 431-442. https://doi.org/10.24093/awej/vol10no2.33
  38. Muhammad, N., Mat Ali, N., Zamani, S., Yamin, N. A., & Ismail, N. N. (2020). Examining assessment literacy: A study of technical teacher. European Journal of Molecular & Clinical Medicine, 7(8), 705-717.
  39. Pastore, S., & Andrade, H. L. (2019). Teacher assessment literacy: A three-dimensional model. Teaching and Teacher Education, 84, 128-138. https://doi.org/10.1016/j.tate.2019.05.003
  40. Plake, B. S., Impara, J. C., & Fager, J. J. (1993). Assessment competencies of teachers: A national survey. Educational Measurement: Issues and Practice, 12(4), 10-12. https://doi.org/10.1111/j.1745-3992.1993.tb00548.x
  41. Popham, W. J. (2009). Assessment literacy for teachers: Faddish or fundamental? Theory into Practice, 48(1), 4-11. https://doi.org/10.1080/00405840802577536
  42. Popham, W. J. (2011). Assessment literacy overlooked: A teacher educator’s confession. Teacher Educator, 46(4), 265-273. https://doi.org/10.1080/08878730.2011.605048
  43. Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18(2), 119-144. https://doi.org/10.1007/BF00117714
  44. Saldana, J. (2013). The coding manual for qualitive researchers (2nd ed.). SAGE Publications.
  45. Tajeddin, Z., Alemi, M., & Yasaei, H. (2018). Classroom assessment literacy for speaking: exploring novice and experienced English language teachers’ knowledge and practice. Iranian Journal of Language Teaching Research, 6(3), 57-77.
  46. Thomas, J., Allman, C., & Beech, M. (2004). Assessment for the diverse classroom: A handbook for teachers. Florida State University. http://www.fldoe.org/core/fileparse.php/7690/urlt/0070083-assess_diverse.pdf
  47. Throndsen, J. E., Shumway, J. F., & Moyer-Packenham, P. S. (2020). The relationship between mathematical literacy at kindergarten entry and public preschool attendance, type, and quality. Early Childhood Education Journal, 48(4), 473-483. https://doi.org/10.1007/s10643-019-01014-7
  48. Xu, H. (2017). Exploring novice EFL teachers’ classroom assessment literacy development: A three-year longitudinal study. Asia-Pacific Education Researcher, 26(3-4), 219-226. https://doi.org/10.1007/s40299-017-0342-5
  49. Xu, Y., & Brown, G. T. L. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58, 149-162. https://doi.org/10.1016/j.tate.2016.05.010
  50. Yamtim, V., & Wongwanich, S. (2014). A study of classroom assessment literacy of primary school teachers. Procedia - Social and Behavioral Sciences, 116, 2998-3004. https://doi.org/10.1016/j.sbspro.2014.01.696
  51. Zolfaghari, F., & Ahmadi, A. (2016). Assessment literacy components across subject matters. Cogent Education, 3(1), 1-16. https://doi.org/10.1080/2331186X.2016.1252561