The standard measurement in online learning: a rubric as a focus on teaching-learning practices to move up quality education
Article Sidebar
Main Article Content
Abstract
The main objective of this paper is to facilitate the 21st century’s quality assurance for learning and distance learning to measure learning outcomes and enable students to achieve skills and knowledge in global transformative education. Technologies in education have provided a common platform for transforming education into online learning practices throughout the global COVID-19 affliction. Accordingly, the transformation of modern technologies in education has opened up many challenges and reliability issues in teaching and learning processes. The paper highlights the rethinking of rubric perceptions, uses, and design in learning, including online learning, in an interactive way to promote quality education. The research methodology involved a systematic review of the literature and data analysis synthesized using both qualitative and quantitative techniques. Rubrics, as an influential assessment instrument in learning, have been applied along with standardizing the quality of students in higher education for almost three decades globally. This study is significant in focusing on the rubric, the practical instrument, which is helpful for great accomplishments and challenging skills, and creativity in tertiary education. Well-designed and carefully designed rubrics and e-rubrics help students become more rational judges of the quality of their work by identifying the essential criteria and targeting the goals and learning outcomes of education. Rubrics enhance students' competency to communicate their ideas effectively, which correlates with the standard of sustainable quality education. Further examination of the rubric is needed to identify the challenges of reliability and authenticity in digital education.
Metrics
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
Reasons Why Online Learning is the Future of Education in 2023. (2022). Education Abroad. https://www.educations.com/articles-and-advice/5-reasons-online-learning-is-future-of-education-17146
Aboagye, E., Yawson, J. A., & Appiah, K. N. (2020). COVID-19 and E-learning the challenges of Students in tertiary institutions in Ghana. Social Education Research. https://doi.org/10.37256/ser.122020422
Allen, D. & Tanner, K. (2006). Rubrics: Tools for Making Learning Goals and Evaluation Criteria Explicit for Both Teachers and Learners. CBE-Life Sciences Education, 5(3). https://doi.org/10.1187/cbe.06-06-0168
Allen, E., & Seaman, J. (2013). Changing course: Ten years of tracking online education in the United States. Babson Park, MA: Babson Survey Research Group and Quahog Research Group. http://www.onlinelearningsurvey.com/reports/changingcourse.pdf
Almahasees, Z., Mohsen, K., & Amin, M. (2021). Faculty's and Students’ Perceptions of Online Learning During COVID-19. Digital Education, 6. https://doi.org/10.3389/feduc.2021.638470
Andrade, H. G. (2001). The effects of instructional rubrics on learning to write. Current Issues in Education, 4(4). http://cie.asu.edw/ois/index.php/cieatasu/article/view/1630
Andrade, H. G. (2005). Teaching with Rubrics: The Good, the Bad, and the Ugly. College Teaching, 53(1). 27-30. https://www.jstor.org/stable/27559213
Arnold, S. D. (2012). Assessing Student Learning Online: Overcoming Reliability Issues. IADIS International Conference on Cognition and Exploratory Learning in Digital Age. https://files.eric.ed.gov/fulltext/ED542719.pdf
Arter, J., & McTighe, J. (2001). Scoring rubrics in the classroom: Using performance criteria for assessing and improving student performance. Corwin Press.
Barker, K. (1999). Quality guidelines for technology-assisted distance education. Vancouver, BC: Community Association for Community Education (CACE) and the Office of Learning Technologies (OLT) of Human Resources Development Canada (HRDC).
Bauer, J. F., & Anderson, R. S. (2000). Evaluating students’ written performance in the online classroom. In R. E. Weiss, D. S. Knowlton, & B. W. Speck (eds.) Principles of effective teaching in the online classroom: New directions for teaching and learning (pp. 65-71). San Francisco: Jossey-Bass.
Bawden, D., & Robinson, L. (2009). The dark side of information: Overload, anxiety and other parados pathologies. Journal of Information Science, 35(2), 180-191. https://scholarworks.umass.edu/pare/vol7/iss1/3
Bresciani, M. J., Zelva, C. L., & Anderson, J. A. (2004). Assessing Student Learning and Development: A Handbook for Practitioners. Washington, DC: National Association of Student Personnel Administrators.
Brookhart, S. (2013). How to create and use rubrics for formative assessment and grading. Alexandria, VA: Association for Supervision & Curriculum Development.
Brookhart, S. M., & Chen, F. (2015). The quality and effectiveness of descriptive rubrics. Educational Review, 67(3), 343-368. https://doi.org/10.1080/00131911.2014.929565
Chase, C. I. (1999). Contemporary assessment for educators. New York: Longman.
Chowdhury, F. (2019). Application of rubrics in the classroom: A vital tool for improvement in assessment, feedback and learning. International Education Studies, 12(1), 61-68. https://doi.org/10.5539/ies.v12n1p61
Crumly, C., & Dietz, P. (2014). Pedagogies for student-centered learning: Online and on-ground. Augsburg Fortress Publishers. https://doi.org/10.2307/j.ctt9mOskc
Crusan, D. (2010). Assessment in the Second Language Writing Classroom. The University of Michigan Press. https://www.press.umich.edu/770334assessment in the second language_writing classroom
Dennick, R., Wilkinson, S., & Purcell, N. (2009). Online Assessment: AMEE Guide No.39. Medical Teacher, 3(3), 192-206. DOI: 10.1080/01421590902792406
Dirlam, D., & Byrne, M. (1978). Standardised developmental ratings. Paper presented at the Annual Meeting of the American Educational Research Association, Toronto, Ontario, Canada.
Dochy, F., Gibels, D., & Segers, M. (2006). Learning and the emerging new assessment culture. In L. Verschafel, F. Dochy, M. Boekaerts & S.Vosniadou (Eds.), Instructional psychology: Past, present and future trends (pp. 191-206). Oxford, Amsterdam: Elsevier.
Drummond, M. (2003). Assessing children’s learning. London: David Fulton.
Education in the 21st Century. (2022). Think Strategic for School. https://thinkstrategicforschools.com/education-21st-century/
Everhart, D., Bushway, D., & Schejbal, D. (2016). Communicating the value of competencies. American Council on Education. Retrieved from https://www.acenet.edu/news-room/
García-Morales, V., Garrido-Moreno, A., Martín-Rojas, R. (2021). The Transformation of Higher Education After the COVID Disrup-tion: Emerging Challenges in an Online Learning Scenario. Frontiers in Psychology, 12. https://doi.org/10.3389/fpsyg.2021.616059
Gautam, P. (2020). Advantages and disadvantages of online learning. E-Learning Industry. https://elearningindustry.com/advantages-and-disadvantages-online-learning
Gulikers, J. T., Bastiaens, T. J., & Kirschner, P. A. (2004). A five-dimensional framework for authentic assess-ment. Educational Tech-nology Research and Development, 52(3), 67. https://doi.org/10.1007 /BF02504676
Goodyear, P. (2002). Teaching online. In N. Hativa & P. Goodyear (eds), Teacher thinking, beliefs and knowledge in higher education (pp. 79-101). Kluwer.
Graham, M., Scarborough, H., & Goodwin, C. (1999). Implementing computer-mediated communication in an undergraduate course: A practical experience. Journal of Asynchronous Learning Networks, 3(1). http://www.aln.org/publications/jaln/v3nl/v3n1 graham.asp
Grant, M. R., & Thornton, H. R. (2007). Best practices in undergraduate adult-centered online learning: Mechanisms for course design and delivery. Journal of Online Learning and Teaching, 3(4), 346-356. https://jolt.merlot.org/documents/grant.pdf
Grudnitski, G. (1997). A forecast of achievement from student profile data. Journal of Accounting Education, 15(4), 549-558. https://doi.org/10.1016/S0748-5751(97)00024-9
Gupta, B. L., & Gupta., P. B. (2021). Rubrics as Versatile Educational Tool for Outcome-Based Education. Journal Of Engineering Technology Education, 15(2), 13-24.
Guskey, Thomas R. (2003). “How Classroom Assessments Improve Learning". Educational, School, and Counseling Psychology Faculty Publica-tions. 9. https://uknowledge.uky.edu/edp_facpub/9
Hannafin, M. J., & Hannafin, K. M. (2010). Cognition and student-centered, web-based learning: Issues and implications for research and theory. In J. Spector, D. Ifenthaler, P. Isaias, & S. D. Kinshuk (Eds.) Learning and instruction in the digital age (pp. 11-23). https://doi.org/10.1007/978-1-4419-1551-1_2
Hartley, J. R., & Collins-Brown, E. (1999). Effective pedagogies for managing collaborative learning in online environments. Education Technology and Society, 2(2). https://www.jstor.org/stable/jeductechsoci.2.2.3
Howell, R. J. (2011). Exploring the impact of grading rubrics on academic performance: Findings from experimental, pre-post evaluation. Journal on Excellence in College Teaching, 22(2), 31-49
Howell, R. J. (2014). Grading rubrics: Hoopla or help? Innovations in Education and Teaching International, 51, 400- 410. https://doi.org/10.1080/14703297.2013.785252
Hricko, M., & Howell, S. (2006). Online assessment and measurement: Foundations and challenges. London: Information Science Publishing.
Huba, M. E., & Freed, J. E. (2000). Learner-Centered Assessment on College Campuses: Shifting the Focus from Teaching to Learning. http://assessment.uconn.edu/what/index.html
Jae, H., & Cowling, J. (2009). Objectivity in grading: The promise of bar codes. College Teaching, 57(1), 51-55. https://doi.org/10.3200/CTCH.57.1.51-55
Jaidev, R. (2011). Rubrics-Based Writing: Liberating Rather Than Restricting in Many Contexts. ELTWO Online. http://blog.nus.edu.sg/eltwo/2011/03/17/
Janssen, G., Meier, V., & Trace, J. (2015). Building a Better Rubric: Mixed Methods Rubric Revision. Assessing Writing, 26, 51-66. https://doi.org/10.1016/j.asw.2015.07.002
Jensen, T. (2019). Higher Education in the Digital Era: The Current State of Transformation Around the World. International Association of Universities (IAU). https://www.iau-aiu.net/IMG/pdf/technology_report_2019.pdf
Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2, 130-144.
Kahneman, D. (2003). A perspective on judgment and choice: mapping bounded rationality. American Pychologist, 58(9), 697. https:/ / doi.org/ 10.1037/0003-066X.58.9.697
Kelly-Riley, D., Brown, G., Condon, B., & Law, R. (2001). Washington State University critical thinking project resource guide. https://web.uri.edu/assessment/files/WSU-Critical-Thinking-Project-Resource-Guide.pdf
Krishnamurthy, S. (2020). The future of business education: a commentary in the shadow of the Covid-19 pandemic. Journal of Business Research,. 117, 1–5. DOI: 10.1016/j.jbusres.2020.05.034
Lizcano, D., Lara, J. A., White, B., et al. (2020). Blockchain-based approach to create a model of trust in open and ubiquitous higher education. Journal of Computing in Higher Education, 32, 109–134. https://doi.org/10.1007/s12528-019-09209-y.
Lowe, M. S., Booth, C., Stone, S., & Tagge, N. (2015). Impacting Information Literacy Learning in First-Year Seminars: A Rubric-Based Evaluation. Portal-Libraries and the Academy, 15(3), 489-512. https://doi.org/10.1353/pla.2015.0030
Luft, J. A. (1999). Rubrics: design and use in science teacher education. Journal of Science Teacher Education, 10(2), 107-121. https://www.jstor.org/stable/43156212
Maatuk, A. M., Elberkawi, E. K., & Alharbi, H. (2022). The COVID-19 pandemic and E-learning: challenges and opportunities from the perspective of students and instructors. Journal of Computing in Higher Education 34, 21-38. https://doi.org/10.1007/s12528-021-09274-2
Macdonald, J. (2002). Developing competent e-learners: The role of assessment. Learning Communities and Assessment Cultures Conference, University of Northumbria, Newcastle, UK. http://www.leeds.ac.uk/educol/documents/00002251.htm
Marinoni, G., van’t Land, H., & Jensen, T. (2020). The Impact of Covid-19 on Higher Education Around the World. IAU Global Survey Report. https://www.iau-aiu.net/IMG/pdf/iau_covid19_and_he_survey_report_final_may_2020.pdf
Melnychenko, A., & Zheliaskova, T. (2021). Transformation of educational process in COVID-19 pandemic. Advanced Education, 18. https://files.eric.ed.gov/fulltext/EJ1316295.pdf
Menéndez-Varela, J. L., & Gregori-Giralt, E. (2016). The contribution of rubrics to the validity of performance assessment: A study of the conservation-restoration and design undergraduate degrees. Assessment & Evaluation Higher Education, 41(2), 228-244. https://doi.org/10.1080/02602938.2014.998169
Mertler, C. A. (2001). Designing score rubrics for your classroom. Practical Assessment, Research and Evaluation, 7(25), 1-8. https://scholarworks.umass.edu/pare/vol7/iss1/25
Morcke, A. M., Dornan, T., & Eika, B. (2013). Outcome (competency) based education: An exploration of its origins, theoretical basis, and empirical evidence. Advances in Health Sciences Education, 18(4), 851-863. doi: 10.1007/10459-012-9405-9
Moreno, R. (2004). Decreasing cognitive load for novice students: Effects of explanatory versus corrective feedback in discovery-based multimedia. Instructional Science, 32(1-2), 99-113. https://doi.org/10.1023/B:TRUC.0000021811.66966.1d
Moril, R., Ballester, L., & Martinez, J. (2012). Introducción de las matrices de valoración analítica en el proceso de evaluación del Practicum de los Grados de Infantil y de Primaria. Revista de Docencia Universitaria, 10(2), 251-271.
Moskal, B. M. (2000). Scoring Rubrics: What, When and How? Practical Assessment, Research, and Evaluation, 7(3). DOI: https://doi.org/10.7275/a5vq-7q66
Mukhtar, K., Javed, K., Arooj, M., & Sethi A. (2020). Advantages, limitations and recommendations for online learning during COVID-19 pandemic era. Pakistan Journal of Medical Science, 36, 27-31. https://doi.org/https://doi.org/10.12669/pjms.36.COVID19-S4.2785
National Center of Education Statistics (NCES). (2016). Percentage of public school districts with students enrolled in technology-based distance education courses and number of enrollments in such courses, by instructional level and district characteristics: 2002-03, 2004-05, and 2009-10. https://nces.ed.gov/programs/digest/d14/tables/dt14_218.20.asp.
Nitko, A. J., & Brookhart, S. M. (2007). Educational Assessment of Students. NJ: Pearson Education.
Nkhoma, C., Nkhoma, M., Thomas, S., & Le, N. Q. (2020). The role of rubrics in learning and implementation of authentic assessment: A Literature review. In M. Jones (Ed.), Proceedings of InSITE 2020: Informing Science and Information Technology Education Conference (237-276). Informing Science Institute. https://doi.org/10.28945/4606
Oakleaf, Megan. (2007). “Using Rubrics to Collect Evidence for Decision-Making: What Do Librarians Need to Learn?” Evidence Based Library and Information Practice. 2.3.
O’Rourke, M. (2010). The development of online assessment in the Moodle Virtual Learning Environment (VLE) as a replacement for traditional written assessment. ILTA EdTech. http://hdl.handle.net/10633/
Pollacia, L., & McCallister, T. (2009). Using Web 2.0 technologies to meet Quality Matters TM (QM) requirements. Journal of Information Systems Education, 20(2), 155-164.
Popham, W. J. (1997). What’s wrong what's right rubrics. Educational Leadership, 55(2), 72-75.
Ragupathi, K., & Lee, A. (2020). Beyond Fairness and Consistency in Grading: The Role of Rubrics in Higher Education. In: Sanger, C., Gleason, N. (eds) Diversity and Inclusion in Global Higher Education. Palgrave Macmillan, Singapore. https://doi.org/10.1007/978-981-15-1628-3_3
Rosenzweig, P. (2014). The halo effect and the eight other business delusions that deceive managers. Simon and Schuster.
Sener, J. (2006). Quality Matters: Inter-institutional quality improvement for online courses. Journal of Asynchronous Learning Networks, 10(1), 69-80.
Sim, G., Holifield, P. & Brown, M. (2004). Implementation of computer assisted assessment: lessons from the literature. ALI-J, Research in Learning Technology, 12(3), 215-29.
Stiggins, R. J. (2001). Student-involved classroom assessment. Merrill Prentice Hall.
Suskie, L. (2018). Assessing student learning: A common sense guide (3rd ed.). Jossey-Bass.
Swan, K., Matthews, D., Bogle, L., Boles, E., & Day, S. (2012). Linking online course design and implementation to learning outcomes: A design experiment. The Internet and Higher Education, 15, 81-88.
Taggart, G. L., Phifer, S. J., Nixon, J. A., & Wood, M. (2001). Rubrics: A handbook for construction and use. Scarecrown Press.
Tedick, D. J. (2002). Proficiency-oriented language instruction and assessment: Standards, philosophies, and considerations for assessment. In D. J. Tedick (Ed.), Proficiency-oriented language instruction and assessment: A curriculum handbook for teachers. CARLA Working Paper Series. Minneapolis, MN: University of Minnesota, The Center for Advanced Research on Language Acquisition. Available online.
The Benefits of Rubrics in Online Classes. (2016). Center for Teaching and Learning. Wiley Education.
Truemper, C. M. ( 2004). Using scoring rubrics to facilitate assessment and evaluation of graduate-level nursing students. Journal Nursing Education, 12, 562-564. https://www.researchgate.net/publication/8110756_Using_Scoring_Rubrics_to_Facilitate_Assessment _and_Evaluation_of_Graduate-Level Nursing_Students
Twigg, C. (2001). Innovations in online learning: Moving beyond no significant difference. http://www.educause.edu/Resources/InnovationsinOnlineLearningMov/155350
Wiggins, G., & McTighe, J. (2005). Understanding by design (2nd ed.). Alexandria, Association for Supervision and Curriculum Development.
Wolf, K., & Stevens, E. (2007). The Role of Rubrics in Advancing and Assessing Student Learning. The Journal of Effective Teaching, 7(1), 3-14. https://files.eric.ed.gov/fulltext/EJ1055646.pdf
Wright, G. B. (2011). Student-centered learning in higher education. International Journal of Teaching and Learning in Higher Education, 23(1), 92-97.