|
Vol.14, No.4, November 2025. ISSN: 2217-8309 eISSN: 2217-8333
TEM Journal
TECHNOLOGY, EDUCATION, MANAGEMENT, INFORMATICS Association for Information Communication Technology Education and Science |
Development of Assessment as Learning Instruments to Improve Chemistry Pre-Service Teachers’ Argumentation Skills Using AI-Assisted Collaborative Argumentation Online Whiteboard
Aulia Rochmah, Suyono Suyono, Suyatno Sutoyo
© 2025 Suyono Suyono, published by UIKTEN. This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. (CC BY-NC-ND 4.0)
Citation Information: TEM Journal. Volume 14, Issue 4, Pages 3459-3469, ISSN 2217-8309, DOI: 10.18421/TEM144-52, November 2025.
Received: 06 January 2025.
Abstract:
The study developed an assessment as learning instrument to foster the argumentation skills of pre-service chemistry teachers. The instrument was designed as an alternative assessment tool that integrates self-assessment, peer assessment, and collaborative discussions on an AI-assisted online whiteboard aligned with Toulmin’s argumentation framework. The ADDIE model guided the development of the instrument. The instrument underwent expert content and construct validation, achieving high validity ratings. Pilot testing with 31 participants demonstrated moderate inter-rater reliability (ICC = 0.621) for peer assessments and moderate correlations between self, peer, and instructor assessments, highlighting the need for improved feedback mechanisms and self-assessment training. The analysis of collaborative argumentation discussion revealed that most arguments demonstrated moderate quality, and a smaller proportion achieved the highest quality level. The analysis of practicality and effectiveness gave moderate ratings. Feedback expressed a need for more explicit instructions, more task time, and improved feedback mechanisms. Assessment as learning based instrument was moderately effective but demonstrated some potential for encouraging reflective, collaborative, and logical argumentation processes. Further refinements are needed to optimize its impact.
Keywords – Assessment as learning, self-assessment, peer assessment, collaborative argumentation. |
|
----------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------------------- |