Affective Computing Cues and Learner Engagement in Virtual Classroom Platforms: A Mixed Evaluation

Authors

  • Qiang Song School of Computer Science, Peking University, Beijing, China Author
  • Alice Shah Paul G. Allen School of Computer Science & Engineering, University of Washington, Seattle, Washington, USA Author
  • Hui Luo School of Computer Science, Peking University, Beijing, China Author

Keywords:

Affective Computing, Learner Engagement, Virtual Classrooms, Multimodal Evaluation, Virtual Classroom Platforms

Abstract

The rapid expansion of online education has fundamentally altered the pedagogical landscape, creating an urgent need to understand and enhance learner engagement in virtual classroom platforms. Traditional online learning environments often suffer from a severe reduction in non-verbal communication, leading to feelings of isolation and decreased cognitive involvement among students. Affective computing presents a promising solution by automatically recognizing, interpreting, and responding to human emotions through multimodal cues such as facial expressions, vocal intonation, and posture. This paper presents a comprehensive mixed evaluation of affective computing cues and their direct impact on learner engagement within synchronous virtual classrooms. Employing a sequential explanatory mixed-methods design, the study investigates both the quantitative correlations between system-detected affective states and self-reported engagement metrics, as well as the qualitative experiences of learners navigating these technologically mediated spaces. The findings suggest that real-time affective feedback mechanisms significantly correlate with heightened behavioral and emotional engagement, provided that privacy concerns and technological inaccuracies are adequately mitigated. The synthesis of sensor-derived affective data with nuanced qualitative insights reveals that while affective computing holds immense potential for personalized pedagogy, its integration requires a delicate balance between continuous monitoring and learner autonomy. The research concludes by offering strategic recommendations for platform developers and instructional designers to optimize virtual learning ecosystems.

References

1. Yan, Y.; Xu, R.; Zhao, Z.; Gao, T.; Shao, G.; Lu, X.; Wei, C.; Zhao, X. Integrating digital image analysis, flash GC E-nose, and SHAP-driven interpretable deep learning for non-destructive aging assessment of citri reticulatae pericarpium. Food Chem. X 2025, 30, 102927.

2. Lei, K.; Yuan, M.; Li, S.; Zhou, Q.; Li, M.; Zeng, D.; Guo, Y.; Guo, L. Performance evaluation of E-nose and E-tongue combined with machine learning for qualitative and quantitative assessment of bear bile powder. Anal. Bioanal. Chem. 2023, 415, 3503–3513.

3. Zhang, Y.; Liu, Y.; Li, H.; Cheng, C.; Jia, Z. MPFBL: Modal pairing-based cross-fusion bootstrap learning for multimodal emotion recognition. Neurocomputing 2025, 658, 131577.

4. Kuang, L.; Tian, X.; Su, Y.; Chen, C.; Zhao, L.; Ma, X.; Han, L.; Chen, C.; Zhang, J. Rapid identification of horse oil adulteration based on deep learning infrared spectroscopy detection method. Spectrochim. Acta Part A Mol. Biomol. Spectrosc. 2025, 330, 125604.

5. Zhou, S.; Lin, H.; Meng, J. Discrimination and chemical composition quantitative model of Raw Moutan Cortex and Moutan Cortex Carbon based on electronic nose and machine learning. Math. Biosci. Eng. 2022, 19, 9079–9097.

6. Pandey, V.K.; Srivastava, S.; Dash, K.K.; Singh, R.; Mukarram, S.A.; Harsányi, E. Machine Learning Algorithms and Fundamentals as Emerging Safety Tools in Preservation of Fruits and Vegetables: A Review. Processes 2023, 11, 1720.

7. Zhao, Z.; Wang, R.; Liu, M.; Bai, L.; Sun, Y. Application of machine vision in food computing: A review. Food Chem. 2025, 463, 141238.

8. Ding, H.; Tong, L.; Huang, Q.; Wang, X.; Ying, Q.; Ma, A.; Xiao, T.; Chen, M. Odor-Chemical Correlation-Based Quality Evaluation of Atractylodes macrocephala via Electronic Nose, HPLC, and Machine Learning. Biomed. Chromatogr. 2025, 39, e70212.

9. Nargesi, M.H.; Kheiralipour, K. Non-destructive prediction of sucrose, proline, ash, and fructose/glucose ratio in date syrup using hyperspectral imaging and machine learning. LWT 2025, 229, 118153.

10. Wang, L.; Yang, Y.; Li, J.; Dong, X.; Yuan, Q.; Zhou, T. Assessment of the ecological quality of P. heterophylla polysaccharides based on machine learning models. Ind. Crops Prod. 2025, 236, 121859.

11. Zeng, J.; Jia, X. Systems Theory-Driven Framework for AI Integration into the Holistic Material Basis Research of Traditional Chinese Medicine. Engineering 2024, 40, 28–50.

12. Chen, S.; Li, C.; Stull, R.; Li, M. Improved Satellite-Based Intra-Day Solar Forecasting with a Chain of Deep Learning Models. Energy Convers. Manag. 2024, 313, 118598.

13. Xu, M.; Wang, J.; Zhu, L. The qualitative and quantitative assessment of tea quality based on E-nose, E-tongue and E-eye combined with chemometrics. Food Chem. 2019, 289, 482–489.

14. Ren, C.; Wu, Y.; Zou, J.; Cai, B. Employing the Interpretable Ensemble Learning Approach to Predict the Bandgaps of the Halide Perovskites. Materials 2024, 17, 2686.

15. Wijaya, D.R.; Afianti, F.; Arifianto, A.; Rahmawati, D.; Kodogiannis, V.S. Ensemble machine learning approach for electronic nose signal processing. Sens. Bio-Sens. Res. 2022, 36, 100495.

16. Ren, G.; Wu, R.; Yin, L.; Zhang, Z.; Ning, J. Description of tea quality using deep learning and multi-sensor feature fusion. J. Food Compos. Anal. 2024, 126, 105924.

17. Rajendran, G.; Raute, R.; Caruana, C. A Comprehensive Review of Solar PV Integration with Smart-Grids: Challenges, Standards, and Grid Codes. Energies 2025, 18, 2221.

18. Di Leo, P.; Ciocia, A.; Malgaroli, G.; Spertino, F. Advancements and Challenges in Photovoltaic Power Forecasting: A Comprehensive Review. Energies 2025, 18, 2108.

19. Zhang, J.; Wu, X.; Liu, S.; Fan, Y.; Chen, Y.; Lyu, G.; Liu, P.; Liu, Z.; He, S. Adaptive batch-fusion self-supervised learning for ultrasound image pretraining. Comput. Med. Imaging Graph. 2025, 124, 102599.

20. Wójcik, S.; Ciepiela, F.; Jakubowska, M. Computer vision analysis of sample colors versus quadruple-disk iridium-platinum voltammetric e-tongue for recognition of natural honey adulteration. Measurement 2023, 209, 112514.

21. Song, Y.; Jia, Z.; Yan, L.; Liu, Y.; Cui, Z.; Wang, Y.; Zhang, C. Exploring the material basis and formation pathways of the burnt aroma during the stir-frying process of Gardeniae Fructus using Sensomics and chemical components approach. Food Chem. X 2025, 29, 102690.

22. European Council, Council of the European Union. 2025. AI Explained: Uses and Impact. Available online: https://www.consilium.europa.eu/en/policies/ai-explained/ (accessed on 12 January 2026).

23. Özüpak, Y. Real-Time Detection of Photovoltaic Module Faults Using a Hybrid Machine Learning Model. Sol. Energy 2025, 302, 114014.

24. Lee, K.; Cho, I.; Kang, M.; Jeong, J.; Choi, M.; Woo, K.Y.; Yoon, K.-J.; Cho, Y.-H.; Park, I. Ultra-Low-Power E-Nose System Based on Multi-Micro-LED-Integrated, Nanostructured Gas Sensors and Deep Learning. ACS Nano 2023, 17, 539–551.

25. Haider, S.A.; Sajid, M.; Sajid, H.; Uddin, E.; Ayaz, Y. Deep Learning and Statistical Methods for Short- and Long-Term Solar Irradiance Forecasting for Islamabad. Renew. Energy 2022, 198, 51–60.

26. Lu, Q.; Yi, M.; Jiang, J. Bioelectronic nose for ultratrace odor detection via brain–computer interface with olfactory bulb electrode arrays. Biosens. Bioelectron. 2025, 285, 117585.

Downloads

Published

2026-05-21

Issue

Section

Articles