Breaking Ground in Skill Assessment: The Construction and Validation of a Problem-Solving Scale for University Students

  • Ma'rifatin Indah Kholili 
    Universitas Sebelas Maret, Surakarta, Jawa Tengah, Indonesia
    Indonesia
  • A Asrowi
    Universitas Sebelas Maret, Surakarta, Jawa Tengah, Indonesia
    Indonesia
  • Agus Tri Susilo
    Universitas Sebelas Maret, Surakarta, Jawa Tengah, Indonesia
    Indonesia

Abstract

Students today is expected to possess 21st-century skills, one of which is Problem Solving Skills (PSS). The importance of mastering this skill needs to be accompanied by the availability of a measuring tool. This research addresses this need by developing and validating the Problem-Solving Skill Scale. The development of this scale is focused on guidance and counseling students. The research and development of this instrument follow the educational design research method according to Plomp and Nieveen. Four hundred students were involved to test the construct validity. Problem-solving skills were measured based on three aspects: (1) Problem-Solving Confidence, (2) Approach-Avoidance Style, (3) Personal Control.  Data were analyzed using the Rasch model by the WinSteps software. The research results describe the instrument's quality, the person-item interaction , the item difficulty level (item measures), fit and misfit items, and the distribution of respondents' abilities and the distribution of item levels on the same scale, and the scale’s ability to measure what it intends to measure. The Rasch analysis results show that the PSS Scale is good, precise, and has item fit with the model.  The PSS Scale is a valid and reliable measuring tool for accurately measuring students' problem-solving skills.  This research discusses implications and recommendations for further research efforts to facilitate the improvement of problem-solving skills in students using this measurement tool.

Keywords
  • Problem-solving skill
  • University Students
  • Scale development
  • Validation
  • Rasch model
Lisensing Information
Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite
Kholili, M. I., Asrowi, A., & Susilo, A. T. (2024). Breaking Ground in Skill Assessment: The Construction and Validation of a Problem-Solving Scale for University Students . KONSELOR, 12(4), 313–325. https://doi.org/10.24036/0202312452-0-86
Endnote/Zotero/Mendeley (RIS) BibTeX
References
  1. Araiza-Alba, P., Keane, T., Chen, W. S., & Kaufman, J. (2021). Immersive Virtual Reality As A Tool To Learn Problem-Solving Skills. Computers And Education, 164(July 2020), 104121. Https://Doi.Org/10.1016/J.Compedu.2020.104121
  2. Asiye, B., & Bilge, C. (2016). An Investigation Of Problem-Solving Skills Of Pre-Service Science Teachers. Educational Research And Reviews, 11(23), 2108–2115. Https://Doi.Org/10.5897/Err2016.3054
  3. Barana, A., Fissore, C., Marchisio, M., & Pulvirenti, M. (2020). Teacher Training For The Development Of Computational Thinking And Problem Posing & Solving Skills With Technologies. 172–180. Https://Doi.Org/10.12753/2066-026x-20-103
  4. Bariyyah, K. (2021). Problem Solving Skills: Esssential Skills Challenges For The 21st Century Graduates. Jurnal EDUCATIO: Jurnal Pendidikan Indonesia, 7(1), 71. Https://Doi.Org/10.29210/120212843
  5. Bernie Trilling, C. F. (2009). 21st Century Skills: Learning For Life In Our Times. 5(5), 3(2), 524–532. Https://Doi.Org/Https://Doi.Org/10.31004/Basicedu.V5i5.1548 Copyright
  6. Boone, W. J. (2016). Rasch Analysis For Instrument Development: Why,When,And How? CBE Life Sciences Education, 15(4). Https://Doi.Org/10.1187/Cbe.16-04-0148
  7. Coşkun, Y. D., Garipağaoğlu, Ç., & Tosun, Ü. (2014). Analysis Of The Relationship Between The Resiliency Level And Problem Solving Skills Of University Students. Procedia - Social And Behavioral Sciences, 114, 673–680. Https://Doi.Org/10.1016/J.Sbspro.2013.12.766
  8. Deniz, S. (2013). The Relationship Between Emotional Intelligence And Problem Solving Skills In Prospective Teachers. Educational Research And Reviews, 8(24), 2339–2345. Https://Doi.Org/10.5897/ERR2013.1584
  9. Devellis, R. F. (2017). Scale Development Theory And Applications (4th Edition) (Vol. 5, Issue 3). Https://Doi.Org/Doi: 300.72—Dc23 LC
  10. Dörner, D., & Funke, J. (2017). Complex Problem Solving: What It Is And What It Is Not. Frontiers In Psychology, 8(JUL), 1–11. Https://Doi.Org/10.3389/Fpsyg.2017.01153
  11. Fajri, I., Yusuf, R., & Mohd Yusoff, M. Z. (2021). Model Pembelajaran Project Citizen Sebagai Inovasi Pembelajaran Dalam Meningkatkan Keterampilan Abad 21. JURNAL HURRIAH: Jurnal Evaluasi Pendidikan Dan Penelitian, 2(3), 105–118. Https://Doi.Org/10.56806/Jh.V2i3.30
  12. Fitarahmawati, & Suhartini. (2021). Empowering Critical Thinking And Problem-Solving Skills During Pandemic Through Contextual Distance-Learning In Biology. Proceedings Of The 6th International Seminar On Science Education (ISSE 2020), 541(Isse 2020), 39–47. Https://Doi.Org/10.2991/Assehr.K.210326.006
  13. Gunawan, G., Harjono, A., Nisyah, M., Kusdiastuti, M., & Herayanti, L. (2020). Improving Students’ Problem-Solving Skills Using Inquiry Learning Model Combined With Advance Organizer. International Journal Of Instruction, 13(4), 427–442. Https://Doi.Org/10.29333/Iji.2020.13427a
  14. Harefa, N., & Purba, L. S. L. (2020). Problem Solving Skills Improvement And The Impact On Students’ Learning Outcomes: Learning Based E-Project. Journal Of Physics: Conference Series, 1567(2). Https://Doi.Org/10.1088/1742-6596/1567/2/022038
  15. Haryanto, U. (2016). Peningkatan Kemampuan Memecahkan Masalah Melalui Media Komputer Dalam Pembelajaran Matematika Pada Siswa SMKN 1 Ngawen. Jurnal Pendidikan Teknologi Dan Kejuruan, 22(4), 432. Https://Doi.Org/10.21831/Jptk.V22i4.7841
  16. Heppner, P. P., & Petersen, C. H. (1982). The Development And Implications Of A Personal Problem-Solving Inventory. Journal Of Counseling Psychology, 29(1), 66–75. Https://Doi.Org/10.1037//0022-0167.29.1.66
  17. Ibrahim, M. E. E., & Ahmed, S. A. E. (2023). Preparing Teacher And Student For Twenty-First-Century Learning Practices: A Framework For Enhancing Collaborative Problem-Solving And Strategic Learning Skills. British Journal Of English Language Linguistics, 11(1), 1–11. Https://Doi.Org/10.37745/Bjel.2013/Vol11n1111
  18. Irawan, R., Kade, A., & Pasaribu, M. (2022). Influence Of Problem-Based Learning With The STEM Using Mobile Learning Toward Problem Solving Physics Ability And Self-Directed Learning Student In Dynamic Electricity Subject Matter. Jurnal Riset Pendidikan MIPA, 6(2), 55–68. Https://Doi.Org/10.22487/J25490192.2022.V6.I2.Pp55-68
  19. Jamari, D. (2016). The Overview Of Problem Solving Skill Through Online Social Networking Platform. Conference: 2nd International Education Postgraduate Seminar (IEPS- 2015)At: Pulai Spring Resort, Johor Bahru, Malaysia, 15(1), 165–175.
  20. K.T. Marselina, I.W. Lasmawan, & N. Dantes. (2021). Pengembangan Instrumen Kemampuan Berpikir Kritis Dan Hasil Belajar Ips Pada Siswa Kelas V Sd. Jurnal Penelitian Dan Evaluasi Pendidikan Indonesia, 11(2), 105–114. Https://Doi.Org/10.23887/Jpepi.V11i2.620
  21. Kourmousi, N., Xythali, V., Theologitou, M., & Koutras, V. (2016). Validity And Reliability Of The Problem Solving Inventory (PSI) In A Nationwide Sample Of Greek Educators. Social Sciences, 5(2). Https://Doi.Org/10.3390/Socsci5020025
  22. Lestari, F. D., & Munahefi, D. N. (2023). Problem-Solving Skills Viewed From Students ’ Learning Style In Problem-Based Learning Assisted By Assemblr Based Javanese Culture Augmented Reality. Indonesian Journal Of Mathematics Education, 6(1), 23–34.
  23. Mandina, S., & Ochonogor, C. (2018). Comparative Effect Of Two Problem-Solving Instructional Strategies On Students’ Achievement In Stoichiometry. Eurasia Journal Of Mathematics, Science And Technology Education, 14(12). Https://Doi.Org/10.29333/Ejmste/95125
  24. Maryati, Prasetyo, Z. K., Wilujeng, I., & Sumintono, B. (2019). Measuring Teachers’ Pedagogical Content Knowledge Using Many-Facet Rasch Model. Cakrawala Pendidikan, 38(3), 452–464. Https://Doi.Org/10.21831/Cp.V38i3.26598
  25. Mourtos, N., Okamoto, N., & Rhee, J. (2004). Defining, Teaching, And Assessing Problem Solving Skills. 7th UICEE Annual Conference On …, February 2004, 9–13. Http://Ae.Sjsu.Edu/Files/Public/Nikos/Backup/Pdf/UICEE 04 Mumbai.Pdf
  26. Mubarok, M. Z., Ismail, H. B., & Ahmad, S. B. (2023). The Urgency Of Mastering Problem Solving In Islamic Education: A Study Of Concepts And Educator Functions. TA’DIBUNA: Jurnal Pendidikan Agama Islam, 6(1), 68. Https://Doi.Org/10.30659/Jpai.6.1.68-81
  27. Mudhofir, F., Cahyono, E., Saptono, S., & ... (2022). How To Improve Problem Solving Ability In Learning Physics: A Systematic Review. International …, 654–666. Https://Proceeding.Unnes.Ac.Id/Index.Php/ISET/Article/View/1819%0Ahttps://Proceeding.Unnes.Ac.Id/Index.Php/ISET/Article/Download/1819/1302
  28. Palennari, M., Rachmawaty, R., & Rahmawati, R. (2022). Profil Keterampilan Pemecahan Masalah Peserta Didik SMA Negeri 1 Tinambung Pada Mata Pelajaran Biologi. Sainsmat : Jurnal Ilmiah Ilmu Pengetahuan Alam, 11(1), 78. Https://Doi.Org/10.35580/Sainsmat111339372022
  29. Plomp, T., & Nieveen, N. (2013). Educational Design Research Educational Design Research. Netherlands Institute For Curriculum Development: SLO, 1–206. Http://Www.Eric.Ed.Gov/Ericwebportal/Recorddetail?Accno=EJ815766
  30. Rahayu, I. A. T., & Adistana, G. A. Y. P. (2018). Mengembangkan Keterampilan Memecahkan Masalah Melalui Pembelajaran Berdasar Masalah. Jurnal Pendidikan (Teori Dan Praktik), 3(2), 86. Https://Doi.Org/10.26740/Jp.V3n2.P86-91
  31. Saputra, W. N. E., Hidayah, N., Ramli, M., & Atmoko, A. (2023). Development And Validation Of Indonesian Peace Of Mind Scale: The Rasch Analysis. International Journal Of Evaluation And Research In Education, 12(2), 877–885. Https://Doi.Org/10.11591/Ijere.V12i2.24847
  32. Savitri, E. N. (2022). Unnes Science Education Journal Accredited Sinta 3 Prospective Science Teachers ’ Problem-Solving Skills Through Sci- Ence-Integrated Learning. Unnes, 11(2), 51–56.
  33. Schoppek, W., Kluge, A., Osman, M., & Funke, J. (2018). Editorial: Complex Problem Solving Beyond The Psychometric Approach. In Frontiers In Psychology (Vol. 9, Issue JUL). Https://Doi.Org/10.3389/Fpsyg.2018.01224
  34. Sole, F. B., & Anggraeni, D. M. (2018). Inovasi Pembelajaran Elektronik Dan Tantangan Guru Abad 21. Jurnal Penelitian Dan Pengkajian Ilmu Pendidikan: E-Saintika, 2(1), 10. Https://Doi.Org/10.36312/E-Saintika.V2i1.79
  35. Suardi, I. P., Ramadhan, S., & Asri, Y. (2019). The Problem Solving Skills In Kindergarten Student Based On The Stages Of Problem Solving. Jurnal Obsesi : Jurnal Pendidikan Anak Usia Dini, 3(1), 265. Https://Doi.Org/10.31004/Obsesi.V3i1.160
  36. Sumintono, B. (2018). Rasch Model Measurements As Tools In Assesment For Learning. 173(Icei 2017), 38–42. Https://Doi.Org/10.2991/Icei-17.2018.11
  37. Syahputra, Y., Ardimen, A., Tanjung, R. F., Erwinda, L., Wulan, A. N., Fadhila, C., & Zulfikar, F. (2022). Pengembangan Instrumen Keterampilan Belajar Mahasiswa. Cenderawasih Journal Of Counseling And Education, 1(2), 55–65. Https://Doi.Org/10.31957/Cjce.V1i2.2631
  38. Trilling, B., & Fadel, C. (2009). 21st Century Skills, Enhanced Edition: Learning For Life In Our Times. 244.
  39. Wahyudi, Arafah, K., & Khaeruddin. (2018). Pengembangan Instrumen Berbasis Keterampilan-Keterampilan Abad Ke-21. Seminar Nasional Fisika, 1–4. Https://Doi.Org/Https://Doi.Org/10.15294/Lik.V41i1.2226
  40. Wahyuni, S., Irianti, M., & Azhar, A. (2015). Problem Solving Skill Of Student With The Implementation Of Modeling Instruction In Dynamic Electric Concept. Program Studi Pendidikan Fisika FKIP Universitas Riau, Pekanbaru, 2(2), 1–10.
  41. Woods, D. R., Hrymak, A. N., Marshall, R. R., Wood, P. E., Crowe, C. M., Hoffman, T. W., Wright, J. D., Taylor, P. A., Woodhouse, K. A., & Bouchard, C. G. K. (1997). Developing Problem Solving Skills: The Mcmaster Problem Solving Program. Journal Of Engineering Education, 86(2), 75–91. Https://Doi.Org/10.1002/J.2168-9830.1997.Tb00270.X
  42. Wulandari, A. Y. R., Agustina, N., Hidayati, Y., & Tsulutsya, F. B. (2019). Increasing Students’ Problem-Solving Ability On The Pressure Concept Through Model-Eliciting Activities (Meas). AIP Conference Proceedings, 2202(July). Https://Doi.Org/10.1063/1.5141671
Check for updates

Issue

Downloads

PDF

Statistic

Abstract Views
: 216 times
PDF
: 94 times