ESTIMATING WEST AFRICAN EXAMINATION COUNCIL MATHEMATICS THEORY TEST ITEMS OVER MULTIPLE FACETS USING GENERALIZABILITY THEORY
DOI:
https://doi.org/10.61841/eg2fc688Keywords:
Generalizability Theory, Mathematics, West African Examination CouncilAbstract
The study investigated the application of generalizability theory in estimating West Africa
Examination Council (WAEC) mathematics test scores over multiple facets. The study
employed random effects, two-facets fully crossed design for a G-study and D-study. A
sample of 898 senior secondary three (SS3) students was used for the study. Four research
questions guided the study. Mathematics Achievement Essay Test (MAET) was used to collect
data for the study.The instrument was validated by three experts in Science Education
Department (one in Mathematics Education Unit and two in Measurement and Evaluation
Unit), Faculty of Education, University of Nigeria Nsukka, Enugu State, Nigeria. The
reliability of the instrument was established using Kendal coefficient of concordance (W) and
reliability coefficient of 0.91 was obtained. A computer program EduG version 6.1-e based
on the Analysis of Variance (ANOVA) and Generalizability Theory (GT) was used to carry
out the Generalizability analysis. The resultrevealed that largest contribution of error
variance was from the students followed by student-by-question-by-rater factor. The third
largest variance component was student-by-question interaction followed by variance of the
rater. The variances due to question, student-by-rater and question-by-rater interaction were
zero each.
Downloads
References
Abakpa, B. O. &Iji, C. O. (2011). Effect of mastering learning approach on senior secondary
school students’ achievement in Geometry. Journal of the Science Teachers
Association of Nigeria, 46 (1).
Adeyemi, B. (2010). Teacher related factors as correlates of pupils achievement in social
studies in South West Nigeria. Electronic J. Res.Edu.Psych. 8 (1): 313 – 332.
Agomuoh, P. C. &Nzewi, U. M. (2003). Effects of videotaped instruction on secondary
school students’ achievement in physics. Journal of the Science Teachers Association
of Nigeria 38 (1&2), 88-93
Anthony, G., &Walshaw, M. (2009). Characteristics of effective teaching of Mathematics: A
view from the West. Journal of Mathematics Education, 2 (2), 147-164.
Asikhia, O. A. (2013). Effect of cognitive restructuring on the reduction of mathematics
anxiety among senior secondary school students in Ogun state, Nigeria. International
Journal of Education and Research. 2(2) 1-20
Brennan, R. L. (2001). Generalizability theory. New York, NY: Springer-Verlag.
Egbulefu C.A. (2013), Estimating measurement error and score dependability in examination
using generalizability theory. (Unpublished Ph.D thesis), University of Nigeria
Nsukka.
Elaine, J. H. (2013). What is mathematics? Retrieved from
https://www.livescience.com/38936-mathematics.html
Enu, J., Osei,K. A. &Nkum, D. (2015).Factors Influencing Students’ Mathematics
Performance in some selected Colleges of Education in Ghana.International Journal
of Education Learning and Development, 3 (3) 68-74. Retrieved from
https://www.eajournals.org/wp-content/uploads/Factors-Influencing-Students----
Mathematics-Performance-In-Some-Selected-Colleges-Of-Education-In-Ghana.pdf
Eraikhuemen, L. (2003). The influence of gender and school location on students’ academic
achievement in senior secondary school Mathematics. ife Journalof Theory and
Research in Education. 7(2), 99-112
Ikeh, F. E. (2016). Estimating multiple sources of variation and score reliability in Economics
essay test using generalizability theory (Unpublished Ph.D Thesis), University of
Nigeria, Nsukka
Ikeh, F. E., Ani, M. F., Kalu, I, A., Iketaku, R. I., Eze, B. A., Madu, B. C., Ene, C. U. (2021).
Application of generalizability theory in estimating score dependability of economics
essay test. International Journal of Mechanical and Production Engineering Research
and Development, 11 (3) 221-228
Kalijah, M.S. (2002). Education, training and careers in Physics for women in Malaysia.
IUPAP International Conference on Women in Physics UNESCO. Paris France.
Kim, S. C & Wilson, M. (2009). A comparative analysis of the ratings in performance
assessment using generaalizability theory. Journal of Applied Measurement, 10(4)
408-423.
Kusmaryono I. (2014). The importance of mathematical power in mathematics learning.
International Conference on Mathematics, Science, and Education, 35-40. Retrieved
from https://icmseunnes.com/2015/wp-content/uploads/2015/10/7.pdf
Lee, Y. (2005). Dependability of scores for a new ESL speaking test: Evaluating prototype
tasks. Retrieved from www.ets.org/research/policy.../imdp
Li, M., Shavelson, R. J., Yin, Y & Wiley, E. W. (2015) Generalizability theory. Retrieved
from https://www.researchgate.net/publication/313966026_Generalizability_Theory
Lin, C. (2014). Issues and challenges in current generalizability theory applications in rated
measurement. Retrieved from https://core.ac.uk/download/pdf/29153028.pdf
Mohamed, L. &Waheed, H. (2011).secondary students’ attitude towards mathematics in a
selected school of Maldives. International Journal of Humanities and Social Science,
1 (15) 277-281
Myford, C. M., & Wolfe, E. W. (2002). Detecting and measuring rater effects using manyfacet Rasch measurement: Part I. Journal of Applied Measurement, 4(4), 386-422.
Myford, C. M., & Wolfe, E. W. (2004). Detecting and measuring rater effects using manyfacet Rasch measurement: Part II. Journal of Applied Measurement, 5(2), 189-227.
Obioma, G. O. (2006). Emerging issues in mathematics education in Nigeria with emphasis
on the strategies for effective teaching and learning of word problems and algebraic
expressions. Journal of Issues on Mathematics, 8 (1) 1-8.
Semmelroth, C.L. (2013). Using generalizability theory to measure sources of variance on a
special education teacher observation tool. Retrieved from
https://core.ac.uk/download/pdf/61729504.pdf
Shavelson, R. J. & Webb, N. M. (2005). Generalizability theory: Overview. Retrieved from
https://www.researchgate.net/publication/227580118_Generalizability_Theory_Overv
iew
Soureshjani, K. H. (2011). Item sequence on test performance: Easy items first? Language
Testing in Asia, 1 (3) 46-59. Retrieved from
https://link.springer.com/content/pdf/10.1186/2229-0443-1-3-46.pdf
Uzun1 N. B., Aktaş, M., Aşiret, S &Yorulmaz, S. (2018). Using generalizability theory to
assess the score reliability o communication skills of dentistry students. Asian
Journal of Education and Training,4 (2), 85-90
Valt, M.V & Maree, K. (2007). South African Journal of Education, 27 (2) 223-241
Yadav, D. K. (2017). Exact definition of mathematics. International Research Journal of
Mathematics, Engineering and IT, 4 (1) 34-42.Retrieved from
https://1library.net/document/qo3nn7jq-exact-definition-of-mathematics.html
Yara, P.O. & Otieno, K.O. (2010). Teaching/Learning Resources and Academic Performance
in Mathematics in Secondary Schools in Bondo District of Kenya, Asian Social
Science, 6 (12) 126-132.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Author
This work is licensed under a Creative Commons Attribution 4.0 International License.
You are free to:
- Share — copy and redistribute the material in any medium or format for any purpose, even commercially.
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
- The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
- Attribution — You must give appropriate credit , provide a link to the license, and indicate if changes were made . You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation .
No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.
