DEVELOPMENT OF A DIGITAL INTELLIGENCE TEST ON WEB APPLICATION FOR LOWER SECONDARY SCHOOL STUDENTS BASED ON THE PERFORMANCE ASSESSMENT CONCEPT
Keywords:
Digital intelligence, Information technology, measurement instrumentAbstract
This research aims 1) to develop and validate the quality of a digital intelligence test for lower secondary students based on the performance assessment concept, and 2) to examine factors discriminating digital intelligence among lower secondary students using the developed digital intelligence test on web applications based on the performance assessment concept. The research sample comprised 100 lower secondary school students in grade 9. Research instruments included: 1) a digital intelligence test on a web application, consisting of 8 task components totaling 27 items, along with an analytic rubric for evaluators, and 2) a survey questionnaire on factors affecting digital intelligence, measured on a 5-point Likert scale, including User Experience (UX) assessment questionnaire and User Interface (UI) assessment questionnaire, both on a 5-point Likert scale. Psychometric properties involving content validity, reliability, difficulty, and discriminant power were examined. Descriptive statistics and Discriminant Analysis.
Research findings revealed that:
1.The digital intelligence test on the web application: 1) Tasks exhibited high content validity (greater than .83), high reliability (.824), moderate difficulty (ranging from .459 to .541), and discriminant power (ranging from .2 to .326). 2) Scoring rubric showed high intra-rater reliability and high inter-rater reliability. 3) User Experience (UX) assessment was at a good level, and user Interface (UI) assessment was at a good level.
2.The variables best discrininating highest level of digital intelligence were attitude towards digital usage (digital), followed by innovation ability (innovation). The variable least discrininating intelligence levels was resource support (support). An equation for group discriminant analysis in standard score form was Z = .596 (Z digital) + .553 (Z innovation) + .366 (Z support), with 100% correct classification of group membership
References
Amonkitpinyo, T. (2023). Digital literacy and online learning capabilities.
Journal of MCU Buddhapanya, 7(4), 87-94.
Albirini, A. (2006). Teachers’ attitudes toward information and communication technologies:
The case of Syrian EFL teachers. Computers & Education, 47(4), 373-398.
Doi: https://doi.org/10.1016/j.compedu.2004.10.013
Bak, G. (2020). The urge of share & fear of missing out - connection between culture shock
and social media activities during erasmus internship. FIKUSZ 2019 -Symposium for
Young Researchers Proceedings, 176-191.
Bartlett, C.A. & Ghoshal, S. (2002) Building competitive advantage through people. MIT
Sloan Management Review, 43, 34-41.
Brookhart, S. M. (2015). Performance assessment: showing what students know and can do.
West Palm Beach: Learning Sciences International.
Charoenwanichkun, P. (2023). Comparison of Confirmatory Factor Analysis of Measurement
Model of Students’ Digital Citizenship Between Maximum Likelihood Estimation and
Bayesian Analysis. Journal of Educational Measurement, 40(107),201-217
DQInstitute. (2021). dqindex.org. Retrieved from https://dqindex.org:
https://dqindex.org/en/assessment
Electronic Transactions Development Agency. (2022). Report on the results of a survey of
internet user behavior in Thailand 2022 Thailand Internet User Behavior 2022.
Bangkok: Ministry of Digital Economy and Society.
Google. (2022). Material Design Guidelines. Retrieved from https://material.io/design
Jaruthavee, R. (2020). The factors related to constructive communication in social media
of undergraduate students in bangkok. Bangkok: Faculty of Humanities,
Srinakharinwirot University.
Kong-lap, L. (2018). Fact Sheet digital intelligence and a study of cyberbullying among
teenagers.Bangkok: Child and Youth Media Institute. http://cclickthailand.com/fact-
sheet-ความฉลาดทางดิจิทัล
Lane, S. (2010). Performance assessment: Thestateoftheart.Stanford, CA: Stanford University.
Ljerka, L., & Lepoglavec, J. (2019). Netiquette and cyberbullying in the context of digital Public relations of schools. ICERI2019 Proceedings, 9561-9566. doi:10.21125/iceri.2019.2331
Maijoor, S., & Witteloostuijn, A. (1996). An empirical test of the re-source-based theory:
Strategic regulation in the Dutch audit industry, in: Strategic Management Journal,
(7), 549-569.
Miller, D., Linn, R & Gronlund, N. (2009). Measurement and Assessment in Teaching.
nded. Upper Saddle River, NJ: Pearson.
Nak-in, N. (2020).8 Skills “Digital Intelligence Quotient” of Students in the Teaching Profession
to Citizenship 4.0. Graduate School Journal Chiang Rai Rajabhat university,14(1),1-11.
Park, Y. (2019). DQ Global Standards Report 2019 Common Framework for Digital Literacy,
Skills and Readiness. Retrieved February 5, 2023, from DQ Institute:
Pasztor, J. (2020). The Urge of Share & Fear of Missing Out - Connection Between Culture
Shockand Social Media Activities During Erasmus Internship.in book: FIKUSZ
symposium for Young Researchers Procedings, 176-191.
Pipatpongumpai, A. (2023). Digital literacy and online learning capabilities.
Journal of MCU Buddhapanya, 8(1), 286-298.
Sangphanta,S .(2019).The Causal Relationship Model of Social Media Usage Behaviors
in Internal Communications of the Ministry of Labour Officer, 4(1), 83-97.
Shashaani, L., & Khalili, A. (2001). Gender and computers: Similarities and differences
in Iranian college students' attitudes toward computers. Computers & Education,
(3-4), 363 - 375. Doi: https://doi.org/10.1016/S0360-1315(01)00059-8
Tangdhanakanond, K. (2023). Performance assessment. Bangkok: Chulalongkorn University
Printing House.
Thammasawas, R. (2021). The multi-level causal factors affecting the digital citizenship of
Lower secondary school students in mukdahan province. Educational Measurement
Mahasarakham University, 28(2), 206-221.
Thungsong, W. (2019). An investigation into digital intelligence at the digital citizenship
level of lower secondary students under sarakhampittayakhomschool, mueng district,
mahasarakham province.Journal of Educational Administration and Supervisor,
Mahasarakham Universit , 10(3), 19-34.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Journal of MCU Buddhapanya Review
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
