Developing Creativity Assessment Instruments for Building Engineering Vocational High School Students Based on Self-Assessment in Creative and Entrepreneurial Product Subjects

Sri Sumarni Sumarni; Vernanda  Atik Dewi Sasanti; Ida  Nugroho Saputro

doi:10.48161/qaj.v5n1a1389

Authors

Sri Sumarni Building Engineering Education, Universitas Sebelas Maret, Surakarta Central Java 57126, Indonesia.
Vernanda Atik Dewi Sasanti Building Engineering Education, Universitas Sebelas Maret, Surakarta Central Java 57126, Indonesia.
Ida Nugroho Saputro Building Engineering Education, Universitas Sebelas Maret, Surakarta Central Java 57126, Indonesia.

DOI:

https://doi.org/10.48161/qaj.v5n1a1389

Abstract

The purpose of this study is to design a creativity assessment device that is valid and reliable and able to provide opportunities for students to evaluate their abilities. This research is development research using development methods with ADDIE stages. This study uses a quantitative descriptive approach. Non-test self-assessment worksheets are used in the creation of creativity tools. The validity of the data was assessed by the expert's team with assessment aspects covering material, construction, and language aspects. The Aiken equation with the coefficient V Aiken is used as a decision rule in determining the validity of the instrument. This study involved 5 expert teams and 72 building engineering vocational students in Surakarta as research respondents. The results showed that the self-assessment-based creativity assessment instrument was valid and reliable so it was suitable for use by vocational students. This study provides a significant contribution to educational assessment in vocational schools, especially in the aspect of creativity needed to support entrepreneurship. The existence of a valid and reliable self-assessment-based creativity assessment instrument allows students to better recognize and develop their creative abilities independently. This instrument also provides insight for teachers and institutions in designing teaching programs that are more in line with the needs of increasing creativity. The results of this study have the potential to direct educational policies that emphasize the development of creative and entrepreneurial skills in vocational schools, which can ultimately improve the quality of graduates so that they are ready to compete in the world of work and entrepreneurship.

Downloads

Download data is not yet available.

References

Astuti, M., Arifin, Z., Nurtanto, M., Mutohhari, F., & Warju, W. (2022). The maturity levels of the digital technology competence in vocational education. International Journal of Evaluation and Research in Education, 11(2), 596–603.

Martaningsih, S. T., Soenarto, & Istiyono, E. (2019). Evaluation model of career counseling program in vocational high school. International Journal of Evaluation and Research in Education, 8(2), 318–329.

Wardana, L. W., et al. (2020). The impact of entrepreneurship education and students’ entrepreneurial mindset: The mediating role of attitude and self-efficacy. Heliyon, 6(9), e04922.

Hatthakijphong, P., & Ting, H. I. (2019). Prioritizing successful entrepreneurial skills: An emphasis on the perspectives of entrepreneurs versus aspiring entrepreneurs. Thinking Skills and Creativity, 34, 100603.

You, J. W. (2021). Enhancing creativity in team project-based learning amongst science college students: The moderating role of psychological safety. Innovations in Education and Teaching International, 58(2), 135–145.

Pritzker, S., & Runco, M. (2020). Encyclopedia of Creativity (Vol. 53, No. 9). Academic Press.

Fatoki, O. O. (2010). Graduate entrepreneurial intention in South Africa: Motivations and obstacles. International Journal of Business and Management, 5(9), 87–98.

Lumpkin, G. T., Steier, L., & Wright, M. (2011). In family business business and strategic. Strategic Entrepreneurship Journal, 306(November), 285–306.

Usmeldi, U., & Amini, R. (2022). Creative project-based learning model to increase creativity of vocational high school students. International Journal of Evaluation and Research in Education, 11(4), 2155–2164.

Hageback, N. (2021). AI for creativity. AI and Creativity, 1, 21–26.

Sternberg, R. J. (2003). Preface: Wisdom, intelligence, and creativity synthesized intelligence. Psychology of Education.

Beghetto, R. A. (2016). Education and creativity. Curated Reference Collection in Neuroscience and Biobehavioral Psychology, 37–41.

Fry, H., Ketteridge, S., & Marshall, S. (2008). Higher education (3rd ed.). United States: Great Britain.

Mostafavi, H., Yoosefee, S., Seyyedi, S. A., Rahimi, M., & Heidari, M. (2020). The impact of educational motivation and self-acceptance on creativity among high school students. Creativity Research Journal, 32(4), 378–382.

Gottman, J. M., et al. (1998). Predicting marital happiness and stability from newlywed interactions. Journal of Marriage and Family, 60(1), 5–22.

Yan, Z., & Brown, G. T. L. (2017). A cyclical self-assessment process: Towards a model of how students engage in self-assessment. Assessment & Evaluation in Higher Education, 42(8), 1247–1262.

Liu, N. F., & Carless, D. (2006). Peer feedback: The learning element of peer assessment. Teaching in Higher Education, 11(3), 279–290.

Donia, M. B. L., O’Neill, T. A., & Brutus, S. (2018). The longitudinal effects of peer feedback in the development and transfer of student teamwork skills. Learning and Individual Differences, 61(May), 87–98.

Sitzmann, T., Ely, K., Brown, K. G., & Bauer, K. N. (2016). Self-assessment cognitive affective of knowledge: Or learning measure? Academy of Management Learning & Education, 9(2), 169–191.

Jativa, F., & Reinoso, M. (2024). Bridging the visualization gap: The integrated VR educational. In Ascilite 2024.

Wahyudi, R., Anori, S., Hidayat, H., & Irfan, D. (2024). Correlational analysis of self-directed learning model on motivation and creativity in electronics education at SMK Negeri 1 Batipuh. Journal of Hypermedia Technology and Learning, 2(3), 229–244.

Vasilev, I. (2024). Overview of the problems of VET education: An attempt for classification and cross-mapping the problems from 2024: A case study. International Journal of Current Science Research and Review, 7(11).

Shah, S. K. A., & Habib, Z. (2022). Assessing feedback practices in classroom assessment at federal government educational institutions of Lahore, Pakistan. International Journal of Evaluation and Research in Education, 11(4), 1825–1832.

Carroll, D. (2020). Observations of student accuracy in criteria-based self-assessment. Assessment & Evaluation in Higher Education, 45(8), 1088–1105.

Šafranj, J., Bulatović, V., & Gak, D. (2024). Motivation types: A key factor in self-regulated ESP learning. International Journal of Cognitive Research in Science, Engineering and Education, 10(2), 123–145.

Sumarni, S., Akhyar, M., Nizam, M., & Widyastono, H. (2022). Designing and validating an instrument to measure the practicality of the research-based blended flipped learning model. Journal Name, 20(4), 1–8.

Taras, M. (2010). Student self-assessment: Processes and consequences. Teaching in Higher Education, 15(2), 199–209.

Park, E., Leonard, A., Delano, J. S., Tang, X., & Grzybowski, D. M. (2020). Rubric-based assessment of entrepreneurial-minded learning in engineering education: A review. International Journal of Engineering Education, 36(6), 2015–2029.

Howells, K. (2018). The future of education and skills: Education 2030. OECD Education Working Papers, 23. Retrieved from http://www.oecd.org/education/2030/E2030_Position_Paper_(05.04.2018).pdf

Fayolle, A., & Gailly, B. (2015). The impact of entrepreneurship education on entrepreneurial attitudes and intention: Hysteresis and persistence. Journal of Small Business Management, 53(1), 75–93.

Kaufman, J. C., & Beghetto, R. A. (2009). Beyond big and little: The Four C model of creativity. Review of General Psychology, 13(1), 1–12.

Francisca, M., Ambarwati, L., & Starki, D. (2007). Memahami arti kreativitas (pp. 22–28).

Fields, Z., & Bisschoff, C. A. (2017). Developing and assessing a tool to measure the creativity of university students. Journal Name, 8923.

Saputro, I. N., Sukatiman, Setiawan, A. H., & Sari, A. I. (2024). The role of social support to foster creative thinking of vocational students in university: Mediating effect of creative self-efficacy. Qubahan Academic Journal, 4(3), 607–618.

Robson, S., & Rowe, V. (2012). Observing young children’s creative thinking: Engagement, involvement and persistence. International Journal of Early Years Education, 20(4), 349–364.

Gafour, W. A. S. (2020). Creative thinking skills – A review article. Journal of Education and e-Learning, 4(May), 44–58.

Antonites, A. J. (2003). The concepts: Creativity, innovation and opportunity finding. University of Pretoria ETD, 65–131.

Du, K., Wang, Y., Ma, X., Luo, Z., Wang, L., & Shi, B. (2020). Achievement goals and creativity: The mediating role of creative self-efficacy. Educational Psychology, 40(10), 1249–1269.

Handayani, S. A., Rahayu, Y. S., & Agustini, R. (2021). Students’ creative thinking skills in biology learning: Fluency, flexibility, originality, and elaboration. Journal of Physics: Conference Series, 1747(1).

Munandar. (2012). Pengembangan kreativitas anak berbakat. Jakarta: Rineka Cipta.

Rahim, F. R., Muttaqiin, A., & Hardinata, A. (2019). A preliminary investigation into critical and creative thinking skills of university students in integrated science class 7 course. Journal of Physics: Conference Series, 1185(1).

Hariyanto, V. L. (2017). Ketuntasan kesiapan berwirausaha siswa SMK melalui pembelajaran kolaborasi. Innovation in Vocational and Technical Education, 10(2), 141–152.

Schunk, D. H. (2012). Learning theories: An educational perspective (6th ed.).

Ćukušić, M., Garača, Ž., & Jadrić, M. (2014). Online self-assessment and students’ success in higher education institutions. Computers & Education, 72, 100–109.

Gikandi, J. W., Morrow, D., & Davis, N. E. (2011). Online formative assessment in higher education: A review of the literature. Computers & Education, 57(4), 2333–2351.

Kunandar. (2014). Penilaian autentik penilaian hasil belajar peserta didik berdasarkan kurikulum 2013. Jakarta: PT Raja Grafindo Persada.

Anggelita, D. M., Mustaji, M., & Mariono, A. (2020). Pengaruh keterampilan kolaborasi terhadap kemampuan pemecahan masalah peserta didik SMK. Education Journal of Technology Education, 5(2), 23.

Haris, A., & Jihad, A. (2013). Evaluasi pembelajaran. Yogyakarta: Multi Pressindo.

Fischer, S., & Barabasch, A. (2023). Conceptualizations and implementation of creativity in higher vocational teacher education – A qualitative study of lecturers. Empirical Research in Vocational Education and Training, 15(1).

Sopiansah, V. A., & Suryana, S. (2019). The level of creativity of vocational school students in 21st-century learning. Proceedings of Icream 2018, 258, 53–57.

Pamungkas, M. D., et al. (2024). Enhancing complex problem-solving skills through STEM-based spatial geometry e-modules. Qubahan Academic Journal, 4(3), 541–556.

Trust, T., & Pektas, E. (2018). Using the ADDIE model and Universal Design for Learning principles to develop an open online course for teacher professional development. Journal of Digital Learning in Teacher Education, 34(4), 219–233.

Arnold, D. G., Beauchamp, T. L., & Bowie, N. E. (2015). The systematic design of instruction (7th ed.). United States of America: Pearson.

Dick, W., Carey, L., & Carey, J. O. (2015). The systematic design of instruction (8th ed.). Florida: Pearson.

Guarte, J. M., & Barrios, E. B. (2006). Estimation under purposive sampling. Communications in Statistics - Simulation and Computation, 35(2), 277–284.

Taherdoost, H. (2016). Validity and reliability of the research instrument: How to test the validation of a questionnaire/survey in research. International Journal of Academic Research in Management, 5(3), 27–36. Retrieved from https://hal.science/hal-02546799/document

Lawshe, C. H. (1975). A quantitative approach to content validity.

Ayre, C., & Scally, A. J. (2014). Critical values for Lawshe’s content validity ratio: Revisiting the original methods of calculation. Measurement and Evaluation in Counseling and Development, 47(1), 79–86.

Setiawan, J., Sudrajat, A., Aman, & Kumalasari, D. (2021). Development of higher order thinking skill assessment instruments in learning Indonesian history. International Journal of Evaluation and Research in Education, 10(2), 545–552.

Sumarni, S., Akhyar, M., Nizam, M., & Widyastono, H. (2022). Developing self-assessment research competency instruments for prospective building engineering teachers.

Aiken, L. R. (1980). Content validity and reliability of single items or questionnaires. Educational and Psychological Measurement, 40(4), 955–959.

Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45, 131–141.

Headrick, T. C. (2016). A note on the relationship between the Pearson product-moment and the Spearman rank-based coefficients of correlation. Open Journal of Statistics, 6(6), 1025–1027.

Taber, K. S. (2018). The use of Cronbach’s alpha when developing and reporting research instruments in science education. Research in Science Education, 48(6), 1273–1296.

Hartiningtyas, L., Purnomo, Elmunsyah, H., & Nurmalasari, R. (2016). Correlation between creative thinking skill and competency achievement with vocational maturity on vocational high school. AIP Conference Proceedings, 1778.

Panadero, E., Brown, G. T. L., & Strijbos, J. W. (2016). The future of student self-assessment: A review of known unknowns and potential directions. Educational Psychology Review, 28(4), 803–830.

Brandt, W. C. (2020). Measuring student success skills: A review of the literature on self-directed learning. Center for Assessment. Retrieved from www.nciea.org

Branch, R. M. (2009). Instructional design: The ADDIE approach. Springer International Publishing. Retrieved from https://doi.org/10.1007/978-0-387-09506-6

Aiken, L. R. (2009). Psychological testing and assessment. Pearson Education India.

Brown, G. T. L., & Harris, L. R. (2014). The future of self-assessment in classroom practice: Reframing self-assessment as a core competency. Frontline Learning Research, 2(1), 22–30.

Karaman, P. (2021). The impact of self-assessment on academic performance: A meta-analysis study. International Journal of Research in Education and Science, 7(4), 1151–1166.

Kaufman, J. C., & Sternberg, R. J. (2019). The Cambridge handbook of creativity. Cambridge University Press.

Beghetto, R. A., Kaufman, J. C., & Baer, J. (2015). Teaching for creativity in the Common Core classroom. Teachers College Press.

Kettler, T., Lamb, K. N., Willerson, A., & Mullet, D. R. (2018). Teachers’ perceptions of creativity in the classroom. Creativity Research Journal, 30(2), 164–171.

Torrance, E. P. (1977). Creativity in the classroom: What research says to the teacher.

Zimmerman, B. J., & Schunk, D. H. (2011). Handbook of self-regulation of learning. New York: Routledge.

Yaragani, V. K. (2023). Assessing bias in risk operations: Mitigation strategies through micro reviews. Journal of Engineering Applications and Technology, 5(6), 1–4.

Ackermann, T. (2023). Mitigating strategies and politeness in German requests. Journal of Politeness Research, 19(2), 355–389.

Tepeli, Y. I., & Gonçalves, J. P. (2024). DCAST: Diverse class-aware self-training mitigates selection bias for fairer learning. Retrieved from http://arxiv.org/abs/2409.20126