Machine Learning Analysis of Junior High Students' Math Representation in HOTS Problems

Dwi Priyo Utomo

doi:10.61650/alj.v2i2.75

Authors

Dwi Priyo Utomo Universitas Muhammadiyah Malang, Indonesia
Email : dwi_priyo@umm.ac.id

https://doi.org/10.61650/alj.v2i2.75

Keywords: Machine Learning, Natural Language Processing, Mathematical Representation, Higher Order Thinking Skills, Junior High School Students

Abstract

This study investigates the mathematical representation processes of junior high school students in Indonesia when solving higher-order thinking Skills (HOTS) problems, using machine learning-based analysis Given the increasing volume of mathematics education research (PER) literature, traditional thematic analysis methods are inadequate for tracking developments and identifying future research directions. To address this, we applied the latent Dirichlet allocation (LDA) algorithm, a natural language processing (NLP) technique, to automate thematic analysis of Indonesian PER literature. Our sample comprised six junior high school students, categorized by mathematical ability into high (2 students), medium (2 students), and low (2 students). Data preprocessing included tokenization, stop-word removal, and stemming to prepare the text corpus for LDA modeling. HOTS problems, which require critical thinking and problem-solving skills, were used to assess students' abilities. The findings highlight three primary aspects of mathematical representation: visual, symbolic, and verbal. High-ability students demonstrated a propensity for using and transforming visual representations innovatively, while medium-ability students predominantly employed symbolic representations. In contrast, low-ability students exhibited limited or no changes in their representations. These results underscore the varying approaches to mathematical problem-solving based on ability levels. This study illustrates the effectiveness of NLP methods in thematic analysis, presenting an automated, comprehensive approach to understanding thematic developments in students' mathematical representation processes. By identifying research gaps and suggesting future research directions, our findings can inform scholars and educators aiming to enhance the quality of mathematics education. However, the small sample size limits the generalizability of the results, and future research with larger samples is recommended to validate and expand upon these findings.

References

Afifah, A., Darmayanti, R., Sugianto, R., & Choirudin, C. (2022). How does Newman analyze student errors when solving BADER story problems? AMCA Journal of Religion and Society, 2(2). DOI: https://doi.org/10.51773/ajrs.v2i2.275

Ahmad, A., Alhanshali, L., Jefferson, I. S., & Dellavalle, R. (2022). Cochrane Skin Group’s Global Social Media Reach: Content Analysis of Facebook, Instagram, and Twitter Posts. JMIR Dermatology, 5(4). https://doi.org/10.2196/40905 DOI: https://doi.org/10.2196/40905

Ardiyanti, B., Choirudin, C., & Ningsih, E. F. (2024). Etnomatematika Bangunan Pionering Pramuka terhadap Minat dan Kreativitas Siswa. Jurnal Penelitian Tindakan Kelas, 3, 156–161. DOI: https://doi.org/10.61650/jptk.v1i3.509

Arif, V. R., Afnan, M., Usmiyatun, U., & Lestari, C. Y. (2023). Development of Social Studies Animation Video (S2AV) Teaching Materials on the Material" Plurality of Indonesian Society" for Junior High School Students. Assyfa Learning Journal, 1, 1–11. DOI: https://doi.org/10.61650/alj.v1i1.2

Bong, M. (1998). Tests of the Internal/External Frames of Reference Model with Subject-Specific Academic Self-Efficacy and Frame-Specific Academic Self-Concepts. Journal of Educational Psychology, 90(1), 102–110. https://doi.org/10.1037/0022-0663.90.1.102 DOI: https://doi.org/10.1037//0022-0663.90.1.102

Chen, H.-X., Li, J., Mu, T.-J., & Hu, S.-M. (2024). SN 2 eRF: A Framework for Neural Radiance Fields given Sparse and Noisy Poses. IEEE Transactions on Visualization and Computer Graphics. https://doi.org/10.1109/TVCG.2024.3439583 DOI: https://doi.org/10.1109/TVCG.2024.3439583

Choirudin, C., Darmayanti, R., Usmiyatun, U., Sugianto, R., & Ananthaswamy, V. (2021). Mathematics teacher vs. media development, What are the learning problems in MTs? AMCA Journal of Religion and Society, 1(1), 19–24. DOI: https://doi.org/10.51773/ajrs.v1i1.280

Coblentz, K. E., Treidel, L. A., Biagioli, F. P., Fragel, C. G., Johnson, A. E., Thilakarathne, D. D., Yang, L., & DeLong, J. P. (2024). A framework for understanding climate change impacts through non-compensatory intra- and interspecific climate change responses. Global Change Biology, 30(6). https://doi.org/10.1111/gcb.17378 DOI: https://doi.org/10.1111/gcb.17378

Darmayanti, R., Baiduri, B., & Sugianto, R. (2022). Learning application derivative algebraic functions: Ethnomathematical studies and digital creator books. Jurnal Cendekia: Jurnal Pendidikan Matematika, 6(2), 2212–2227.

Dehaene, S. (2001). Towards a cognitive neuroscience of consciousness: Basic evidence and a workspace framework. Cognition, 79(1), 1–37. https://doi.org/10.1016/S0010-0277(00)00123-2 DOI: https://doi.org/10.1016/S0010-0277(00)00123-2

Diaz, D. J., Gong, C., Ouyang-Zhang, J., Loy, J. M., Wells, J., Yang, D., Ellington, A. D., Dimakis, A. G., & Klivans, A. R. (2024). Stability Oracle: a structure-based graph-transformer framework for identifying stabilizing mutations. Nature Communications, 15(1), 6170. https://doi.org/10.1038/s41467-024-49780-2 DOI: https://doi.org/10.1038/s41467-024-49780-2

Elliot, A. J. (2001). A 2 × 2 achievement goal framework. Journal of Personality and Social Psychology, 80(3), 501–519. https://doi.org/10.1037/0022-3514.80.3.501 DOI: https://doi.org/10.1037//0022-3514.80.3.501

Gabarron, E., Larbi, D., Dorronzoro, E., Hasvold, P. E., Wynn, R., & Årsand, E. (2020). Factors Engaging Users of Diabetes Social Media Channels on Facebook, Twitter, and Instagram: Observational Study. Journal of Medical Internet Research, 22(9). https://doi.org/10.2196/21204 DOI: https://doi.org/10.2196/21204

Glenthøj, A., van Beers, E. J., van Wijk, R., Rab, M. A. E., Groot, E., Vejlstrup, N., Toft, N., Bendtsen, S. K., Petersen, J., Helby, J., Chermat, F., Fenaux, P., & Kuo, K. H. M. (2024). Designing a single-arm phase 2 clinical trial of mitapivat for adult patients with erythrocyte membranopathies (SATISFY): a framework for interventional trials in rare anaemias - pilot study protocol. BMJ Open, 14(7). https://doi.org/10.1136/bmjopen-2023-083691 DOI: https://doi.org/10.1136/bmjopen-2023-083691

Golden, J. S., Virdin, J., Nowacek, D., Halpin, P., Bennear, L., & Patil, P. G. (2017). Making sure the blue economy is green. Nature Ecology & Evolution, 1(2), 17. https://doi.org/10.1038/s41559-016-0017 DOI: https://doi.org/10.1038/s41559-016-0017

Gunawardena, K. R. (2017). Utilising green and bluespace to mitigate urban heat island intensity. Science of the Total Environment, 584, 1040–1055. https://doi.org/10.1016/j.scitotenv.2017.01.158 DOI: https://doi.org/10.1016/j.scitotenv.2017.01.158

Helfrich, C. D. (2007). Assessing an organizational culture instrument based on the Competing Values Framework: Exploratory and confirmatory factor analyses. Implementation Science, 2(1). https://doi.org/10.1186/1748-5908-2-13 DOI: https://doi.org/10.1186/1748-5908-2-13

Hoang, D.-T., Dinstag, G., Shulman, E. D., Hermida, L. C., Ben-Zvi, D. S., Elis, E., Caley, K., Sammut, S.-J., Sinha, S., Sinha, N., Dampier, C. H., Stossel, C., Patil, T., Rajan, A., Lassoued, W., Strauss, J., Bailey, S., Allen, C., Redman, J., … Ruppin, E. (2024). A deep-learning framework to predict cancer treatment response from histopathology images through imputed transcriptomics. Nature Cancer. https://doi.org/10.1038/s43018-024-00793-2 DOI: https://doi.org/10.1038/s43018-024-00793-2

Inganah, S., Rizki, N., Choirudin, C., Farooq, S. M. Y., & Susanti, N. (2023). Integration of Islamic values, mathematics, and career readiness competencies of prospective teachers in Islamic universities. Delta-Phi: Jurnal Pendidikan Matematika, 1, 11–14. DOI: https://doi.org/10.61650/dpjpm.v1i1.31

Jeri-Yabar, A., Sanchez-Carbonel, A., Tito, K., Ramirez-delCastillo, J., Torres-Alcantara, A., Denegri, D., & Carreazo, Y. (2019). Association between social media use (Twitter, Instagram, Facebook) and depressive symptoms: Are Twitter users at higher risk? The International Journal of Social Psychiatry, 65(1), 14–19. https://doi.org/10.1177/0020764018814270 DOI: https://doi.org/10.1177/0020764018814270

Kaplan, S. (1995). The restorative benefits of nature: Toward an integrative framework. Journal of Environmental Psychology, 15(3), 169–182. https://doi.org/10.1016/0272-4944(95)90001-2 DOI: https://doi.org/10.1016/0272-4944(95)90001-2

Kaur, K., & Gurnani, B. (2022). Commentary: Impact of social media applications like Instagram, Facebook, Twitter, and YouTube on ophthalmological education. Indian Journal of Ophthalmology, 70(9), 3253–3254. https://doi.org/10.4103/ijo.IJO_1729_22 DOI: https://doi.org/10.4103/ijo.IJO_1163_22

Laila, A. R. N., Cholily, Y. M., Syaifuddin, M., Sugianto, R., & Muhammad, I. (2023). Desain Modul Matematika Bilingual: Urgensi Pengembangan Media Matematika Bilingual dengan konten Islami. Assyfa Journal of Islamic Studies, 1(1). DOI: https://doi.org/10.61650/ajis.v1i2.133

Leavesley, A., Trundle, A., & Oke, C. (2022). Cities and the SDGs: Realities and possibilities of local engagement in global frameworks. Ambio, 51(6), 1416–1432. https://doi.org/10.1007/s13280-022-01714-2 DOI: https://doi.org/10.1007/s13280-022-01714-2

Liu, J., Luo, Z., Wu, J., Qian, D., Liao, W., Waterhouse, G. I. N., & Chen, X. (2024). Iron-Cobalt Phosphide Encapsulated in a N-Doped Carbon Framework as a Promising Low-Cost Oxygen Reduction Electrocatalyst for Zinc-Air Batteries. Inorganic Chemistry, 63(27), 12681–12689. https://doi.org/10.1021/acs.inorgchem.4c02077 DOI: https://doi.org/10.1021/acs.inorgchem.4c02077

Metwally, A. A., Perelman, D., Park, H., Wu, Y., Jha, A., Sharp, S., Celli, A., Ayhan, E., Abbasi, F., Gloyn, A. L., McLaughlin, T., & Snyder, M. (2024). Predicting Type 2 Diabetes Metabolic Phenotypes Using Continuous Glucose Monitoring and a Machine Learning Framework. MedRxiv : The Preprint Server for Health Sciences. https://doi.org/10.1101/2024.07.20.24310737 DOI: https://doi.org/10.1101/2024.07.20.24310737

Mir, N. U. D., Karthik, V., Sundari, K. A., Dhakshinamoorthy, A., & Biswas, S. (2024). A Thiophene Functionalized Hf(IV)-Organic Framework for the Detection of Anti-Neoplastic Drug Flutamide and Biomolecule Hemin and Catalysis of Friedel-Crafts Alkylation. Chemistry, an Asian Journal. https://doi.org/10.1002/asia.202400274 DOI: https://doi.org/10.1002/asia.202400274

Moitzi, F., Romaner, L., Ruban, A. V, Hodapp, M., & Peil, O. E. (2024). Ab initio framework for deciphering trade-off relationships in multi-component alloys. Npj Computational Materials, 10(1), 152. https://doi.org/10.1038/s41524-024-01342-2 DOI: https://doi.org/10.1038/s41524-024-01342-2

Mondal, H., Dhabal, A., Mondal, S., & Podder, I. (2024). Social Media and Urticaria - A Data Audit of Facebook®, LinkedIn®, and Twitter® Posts. Indian Journal of Dermatology, 69(1), 106. https://doi.org/10.4103/ijd.ijd_112_23 DOI: https://doi.org/10.4103/ijd.ijd_112_23

Northcott, C., Curtis, R., Bogomolova, S., Olds, T., Vandelanotte, C., Plotnikoff, R., & Maher, C. (2021). Evaluating the effectiveness of a physical activity social media advertising campaign using Facebook, Facebook Messenger, and Instagram. Translational Behavioral Medicine, 11(3), 870–881. https://doi.org/10.1093/tbm/ibaa139 DOI: https://doi.org/10.1093/tbm/ibaa139

Oh, J. Y., Seu, M.-S., Barui, A. K., Ok, H. W., Kim, D., Choi, E., Seong, J., Lah, M. S., & Ryu, J.-H. (2024). A multifunctional protein pre-coated metal-organic framework for targeted delivery with deep tissue penetration. Nanoscale. https://doi.org/10.1039/d4nr02345e DOI: https://doi.org/10.1039/D4NR02345E

Ong, H. I., Shulman, N., Nugraha, P., Wrenn, S., Nally, D., Peirce, C., Mahmood, U., McCormick, J., Proud, D., Warrier, S., Fleming, C., & Mohan, H. (2024). Role of robot-assisted laparoscopy in deep infiltrating endometriosis with bowel involvement: a systematic review and application of the IDEAL framework. International Journal of Colorectal Disease, 39(1), 98. https://doi.org/10.1007/s00384-024-04669-w DOI: https://doi.org/10.1007/s00384-024-04669-w

Pandia, W. S. S., Naim, M. A., & Siddique, M. (2023). Student growth, qualities, and abilities in developing religious ideals from childhood. Which approach works? Assyfa Journal of Islamic Studies, 1. DOI: https://doi.org/10.61650/ajis.v1i1.320

Poomchaichote, T., Kiatying-Angsulee, N., Boonthaworn, K., Naemiratch, B., Ruangkajorn, S., Prapharsavat, R., Thirapantu, C., Sukrung, K., Limmathurotsakul, D., Osterrieder, A., & Cheah, P. Y. (2024). Embedding community and public voices in co-created solutions to mitigate antimicrobial resistance (AMR) in Thailand using the “Responsive Dialogues” public engagement framework. Antimicrobial Resistance and Infection Control, 13(1), 71. https://doi.org/10.1186/s13756-024-01416-2 DOI: https://doi.org/10.1186/s13756-024-01416-2

Sahu, M., Xiao, Y., Porras, J. L., Amanian, A., Jain, A., Thamboo, A., Taylor, R. H., Creighton, F. X., & Ishii, M. (2024). A Label-Efficient Framework for Automated Sinonasal CT Segmentation in Image-Guided Surgery. Otolaryngology–Head and Neck Surgery : Official Journal of American Academy of Otolaryngology-Head and Neck Surgery. https://doi.org/10.1002/ohn.868 DOI: https://doi.org/10.1002/ohn.868

Solehudin, R. H., & Darmayanti, R. (2018a). Does token economy behaviour modification affect young children’s discipline? Jurnal Caksana: Pendidikan Anak Usia Dini, 1(2), 202–215.

Solehudin, R. H., & Darmayanti, R. (2018b). Does token economy behaviour modification affect young children’s discipline? Jurnal Caksana: Pendidikan Anak Usia Dini, 1(2), 202–215.

Sugianto, R., & Darmayanti, R. (2021). Teachers in their perceptions and influences on LINU, positive or negative? AMCA Journal of Science and Technology, 1(1), 20–24. DOI: https://doi.org/10.51773/ajst.v1i1.265

Sun, Z., Wu, Z., Zong, Y., Li, C., Guo, W., Guo, Y., & Zou, X. (2024). Construction of Metal-Organic Framework as a Novel Platform for Ratiometric Determination of Cyanide. Biosensors, 14(6). https://doi.org/10.3390/bios14060276 DOI: https://doi.org/10.3390/bios14060276

Thomas, R. B., Johnson, P. T., & Fishman, E. K. (2018). Social Media for Global Education: Pearls and Pitfalls of Using Facebook, Twitter, and Instagram. Journal of the American College of Radiology : JACR, 15(10), 1513–1516. https://doi.org/10.1016/j.jacr.2018.01.039 DOI: https://doi.org/10.1016/j.jacr.2018.01.039

Valero-Morales, I., Nieto, C., García, A., Espinosa-Montero, J., Aburto, T. C., Tatlow-Golden, M., Boyland, E., & Barquera, S. (2023). The nature and extent of food marketing on Facebook, Instagram, and YouTube posts in Mexico. Pediatric Obesity, 18(5). https://doi.org/10.1111/ijpo.13016 DOI: https://doi.org/10.1111/ijpo.13016

Wu, Y., Xie, Y., & Jin, Z. (2024). Spherical 2-acetylene-(copper metal-organic framework) preparation and efficient photocatalytic hydrogen evolution over combined bimetallic sulfides. Physical Chemistry Chemical Physics : PCCP, 26(27), 18788–18798. https://doi.org/10.1039/d4cp02164a DOI: https://doi.org/10.1039/D4CP02164A

Yang, Y., Zhang, J., Xu, Y., Chen, M., Wang, S., Lin, G., Huang, Y., Yang, C., & Song, Y. (2024). Spatial Engineering of Heterotypic Antigens on a DNA Framework for the Preparation of Mosaic Nanoparticle Vaccines with Enhanced Immune Activation against SARS-CoV-2 Variants. Angewandte Chemie (International Ed. in English). https://doi.org/10.1002/anie.202412294 DOI: https://doi.org/10.1002/anie.202412294

Yi, S., & Zhou, L. (2024). Multi-step framework for glaucoma diagnosis in retinal fundus images using deep learning. Medical & Biological Engineering & Computing. https://doi.org/10.1007/s11517-024-03172-2 DOI: https://doi.org/10.1007/s11517-024-03172-2

Zahroh, U., Maghfiroh, W., Darmayanti, R., & Hidayat, A. (2023). Innovation in mathematics education for high school students using small group discussion as a case study. Assyfa International Scientific Journal, 1, 8–14. DOI: https://doi.org/10.61650/ajis.v1i2.239

Zhang, C., Yu, S., & Ji, J. (2024). CFI: a VR motor rehabilitation serious game design framework integrating rehabilitation function and game design principles with an upper limb case. Journal of Neuroengineering and Rehabilitation, 21(1), 113. https://doi.org/10.1186/s12984-024-01373-2 DOI: https://doi.org/10.1186/s12984-024-01373-2

Zhou, J. X., Lim, C., & Krishna, L. K. R. (2024). VOWELS: A communication framework for disclosing medical errors in medical oncology and palliative care. Annals of the Academy of Medicine, Singapore, 53(4), 272–273. https://doi.org/10.47102/annals-acadmedsg.2023380 DOI: https://doi.org/10.47102/annals-acadmedsg.2023380

Zhou, S., Cai, H., Tang, Z., & Lu, S. (2024). Carbon dots encapsulated zeolitic imidazolate framework-8 as an enhanced multi-antioxidant for efficient cytoprotection to HK-2 cells. Journal of Colloid and Interface Science, 676, 726–738. https://doi.org/10.1016/j.jcis.2024.07.150 DOI: https://doi.org/10.1016/j.jcis.2024.07.150