Abstract
The integration of Generative Artificial Intelligence (GenAI) into higher education has outpaced the development of pedagogical models capable of directing it towards higher-order learning. Unstructured, zero-shot interaction with Large Language Models tends to yield fluent but uncritical output, while conventional assessment instruments are not designed to capture the quality of a learner's interaction with an AI system. This article addresses that gap by presenting the design of a Personalized Multi-Agent System (MAS) built upon the CIDI (Clarify, Ideate, Develop, Implement) pedagogical framework, together with the assessment architecture required to evaluate it. Following a design-based research methodology, four components are specified. First, the CIDI framework is articulated as a four-stage model of structured human-AI interaction, grounded in Distributed Cognition Theory and Cognitive Load Theory. Second, a dual-agent architecture is specified in full: an Ideation Agent configured for divergent generation and a Critical Evaluator Agent configured for convergent methodological critique, each defined by its system prompt and temperature configuration, and both integrated into an institutional Learning Management System. Third, a complete instructional design is presented, implementing the framework as a four-stage research-planning task within a research methodology curriculum, and introducing the Iterative Refinement Cycle (IRC) as an observable indicator of dialogic engagement recoverable from LMS logs. Fourth, two purpose-built assessment instruments are introduced: a 100-point Cognitive Competence Score rubric addressing problem formulation, methodological rigour, logical structuring and academic literacy; and an analytic rubric operationalizing Torrance's four dimensions of divergent thinking. The article concludes with a validation protocol specifying the design, reliability indices and analytic procedures required for subsequent empirical testing. The contribution is methodological: it supplies a reproducible architecture and a transparent instrumentation set for research on structured human-AI interaction in higher education.
References
[1] Z. Ji, N. Lee, R. Frieske, T. Yu, D. Su, Y. Xu, E. Ishii, Y. J. Bang, A. Madotto, and P. Fung, "Survey of hallucination in natural language generation," ACM Comput. Surv., vol. 55, no. 12, Art. no. 248, pp. 1-38, Mar. 2023. doi: 10.1145/3571730. (in English)
[2] D. Federiakin, D. Molerov, O. Zlatkin-Troitschanskaia, and A. Maur, "Prompt engineering as a new 21st century skill," Front. Educ., vol. 9, Art. no. 1366434, 2024. doi: 10.3389/feduc.2024.1366434. (in English)
[3] Y. Walter, "Embracing the future of Artificial Intelligence in the classroom: the relevance of AI literacy, prompt engineering, and critical thinking in modern education," Int. J. Educ. Technol. High. Educ., vol. 21, no. 1, Art. no. 15, 2024. doi: 10.1186/s41239-024-00448-3. (in English)
[4] F. Karakaya, S. N. Caner, Z. Cakmak, E. Eser, and B. N. Bal, "The role of prompt writing in AI-supported teaching: Views of prospective science teachers," Int. J. Educ. Math. Sci. Technol., vol. 14, no. 3, pp. 737-755, 2026. (in English)
[5] Y. Zhou, A. I. Muresanu, Z. Han, K. Paster, S. Pitis, H. Chan, and J. Ba, "Large language models are human-level prompt engineers," in Proc. 11th Int. Conf. Learn. Represent. (ICLR), Kigali, Rwanda, May 2023. (in English)
[6] M.-C. Chiu and G.-J. Hwang, "Enhancing student creative and critical thinking in generative AI-empowered creation: a mind-mapping approach," Interact. Learn. Environ., vol. 34, no. 2, pp. 869-890, 2025. doi: 10.1080/10494820.2025.2453645. (in English)
[7] M. H. Hussein, S. H. Ow, M. M. Elaish, and E. O. Jensen, "Comparing the impact of individual- and team-based ChatGPT collaboration on high school students’ cognitive competencies in programming education," J. Comput. Assist. Learn., vol. 42, no. 2, Art. no. e70226, 2026. (in English)
[8] S. Tumen Akyildiz, "Prompt engineering and creative pedagogical thinking: Insights from a qualitative study with teacher candidates," Think. Skills Creat., vol. 60, Art. no. 102105, 2026. doi: 10.1016/j.tsc.2025.102105. (in English)
[9] A. Mirkovic Mogus, "Using prompt engineering to foster critical thinking in higher education," in Proc. 16th Int. Conf. eLearning, Belgrade, Serbia, 2025. (in English)
[10] E. Hutchins, Cognition in the Wild. Cambridge, MA, USA: MIT Press, 1995. (in English)
[11] J. Sweller, "Cognitive load during problem solving: Effects on learning," Cogn. Sci., vol. 12, no. 2, pp. 257-285, 1988. doi: 10.1207/s15516709cog1202_4. (in English)
[12] R. C. Davila-Moran et al., "Brief prompt-engineering clinic substantially improves AI literacy and reduces technology anxiety in first-year teacher-education students: A pre-post pilot study," Educ. Sci., vol. 15, no. 8, Art. no. 1010, 2025. doi: 10.3390/educsci15081010. (in English)
[13] B. Kurt, G. Arik Karamik, and A. Ozkaya, "Investigating the correlation between candidate teachers’ acceptance of generative artificial intelligence and artificial intelligence literacy across various disciplines," PLoS One, vol. 21, no. 3, Art. no. e0342853, 2026. (in English)
[14] S. Tassoti, "Assessment of student use of generative artificial intelligence: Prompting strategies and prompt engineering in chemistry education," J. Chem. Educ., vol. 101, no. 6, pp. 2475-2482, 2024. doi: 10.1021/acs.jchemed.4c00212. (in English)
[15] M. Sigot and S. Tassoti, "An investigation of change in prompting strategies in a semester-long course on the use of GenAI," J. Chem. Educ., vol. 102, no. 6, pp. 2507-2513, 2025. (in English)
[16] M. R. Reddy, N. G. Walter, and Y. V. Sevryugina, "Implementation and evaluation of a ChatGPT-assisted special topics writing assignment in biochemistry," J. Chem. Educ., vol. 101, no. 7, pp. 2740-2748, 2024. (in English)
[17] E. Yuriev et al., "Integrating generative AI in chemistry education: Enhancing career-ready writing skills in pharmaceutical science," J. Chem. Educ., vol. 102, no. 5, pp. 1991-2001, 2025. (in English)
[18] F. Wang and M. J. Hannafin, "Design-based research and technology-enhanced learning environments," Educ. Technol. Res. Dev., vol. 53, no. 4, pp. 5-23, 2005. doi: 10.1007/BF02504682. (in English)
[19] E. P. Torrance, Torrance Tests of Creative Thinking: Norms-Technical Manual. Princeton, NJ, USA: Personnel Press, 1974. (in English)
[20] K. H. Kim, "Can we trust creativity tests? A review of the Torrance Tests of Creative Thinking (TTCT)," Creativity Res. J., vol. 18, no. 1, pp. 3-14, 2006. doi: 10.1207/s15326934crj1801_2. (in English)
[21] J. Cohen, Statistical Power Analysis for the Behavioral Sciences, 2nd ed. Hillsdale, NJ, USA: Lawrence Erlbaum Associates, 1988. (in English)
[22] T. K. Koo and M. Y. Li, "A guideline of selecting and reporting intraclass correlation coefficients for reliability research," J. Chiropr. Med., vol. 15, no. 2, pp. 155-163, 2016. doi: 10.1016/j.jcm.2016.02.012. (in English)

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Copyright (c) 2026 Samvel Asatryan

