Evaluasi Validitas dan Reliabilitas Instrumen Penelitian Kuantitatif: Sebuah Studi Pustaka

Putu Gede Subhaktiyasa

doi:10.37985/jer.v5i4.1747

Authors

Putu Gede Subhaktiyasa STIKES Wira Medika Bali

DOI:

https://doi.org/10.37985/jer.v5i4.1747

Keywords:

validitas isi, validitas konstruk, validitas kriteria, reliablitas, instrumen penelitian

Abstract

Validitas dan reliabilitas terbukti sebagai dua aspek penting yang menentukan kualitas instrumen dalam mengukur variabel penelitian, namun masih dibutuhkan konsistensi dalam penerapannya. Penelitian ini bertujuan untuk memberikan pemahaman terkait uji validitas dan reliablitas yang perlu dilakukan untuk menghasilkan instrumen penelitian yang baik. Studi merupakan penelitian kualitatif melalui pendekatan studi pustaka. Temuan penelitian menunjukkan bahwa perubahan dalam konteks sosial dan budaya dapat mempengaruhi keandalan instrumen yang telah teruji di masa lalu. Studi menekankan pentingnya pengujian ulang instrumen melalui beberapa uji validitas dan reliabilitas untuk memastikan akurasi pengumpulan data. Hasil penelitian berkontribusi dalam pengembangan dan pengujian instrumen yang lebih efektif untuk meningkatkan kredibilitas hasil penelitian.

Downloads

Download data is not yet available.

References

Agung, A. A. G. (2018). Quantitative Research Methodology (Education Management Perspective). Universitas Pendidikan Ganesha.

Alcaraz-Ibáñez, M., Paterna, A., Sicilia, Á., & Griffiths, M. D. (2022). Examining the reliability of the scores of self-report instruments assessing problematic exercise: A systematic review and meta-analysis. Journal of Behavioral Addictions, 11(2), 326–347. https://doi.org/10.1556/2006.2022.00014

Amir Behghadami, M., Janati, A., Sadeghi-Bazargani, H., Gholizadeh, M., Rahmani, F., & Arab-Zozani, M. (2019). Developing and validating an instrument to assess non-hospital health centers' preparedness to provide initial emergency care: a study protocol. BMJ Open, 9(7), e026651. https://doi.org/10.1136/bmjopen-2018-026651

Andrade, C. (2021). A Student's Guide to the Classification and Operationalization of Variables in the Conceptualization and Design of a Clinical Study: Part 1. Indian Journal of Psychological Medicine, 43(2), 177–179. https://doi.org/10.1177/0253717621994334

Anthoine, E., Moret, L., Regnault, A., Sébille, V., & Hardouin, J.-B. (2014). Sample size used to validate a scale: a review of publications on newly-developed patient reported outcomes measures. Health and Quality of Life Outcomes, 12(1), 2. https://doi.org/10.1186/s12955-014-0176-2

Bowen, G. A. (2009). Document analysis as a qualitative research method. Qualitative Research Journal, 9(2), 27–40. https://doi.org/10.3316/QRJ0902027

Bushmakin, A. G., & Cappelleri, J. C. (2022). Construct Validity and Criterion Validity. In A Practical Approach to Quantitative Validation of Patient‐Reported Outcomes (pp. 151–249). https://doi.org/https://doi.org/10.1002/9781119376354.ch5

Candrawati, S. A. K., Sriani, N. K. A., Suabhaktiyasa, P. G., Andini, N. K. S., Putri, N. L. N. D. D., Citrawati, N. K., & Andriany, M. (2024). Spiritual Leadership Enhances Caring Behaviour: The Mediating Role of Calling. Nurse Media Journal of Nursing, 14(2). https://doi.org/https://doi.org/10.14710/nmjn.v14i2.58964

Cha, S., Erar, B., Niaura, R. S., & Graham, A. L. (2016). Baseline Characteristics and Generalizability of Participants in an Internet Smoking Cessation Randomized Trial. Annals of Behavioral Medicine, 50(5), 751–761. https://doi.org/10.1007/s12160-016-9804-x

Cisneros-Barahona, A. S., Marqués-Molías, L., Samaniego-Erazo, N., Mejía-Granizo, C., & De la Cruz-Fernández, G. (2023). Multivariate data analysis: Validation of an instrument for the evaluation of teaching digital competence. F1000Research, 12(May), 1–24. https://doi.org/10.12688/f1000research.135194.2

Clark, L. A., & Watson, D. (2019). Constructing validity: New developments in creating objective measuring instruments. Psychological Assessment, 31(12), 1412–1427. https://doi.org/10.1037/pas0000626

Cruz, M. L., Bogaard, M. E. D. van den, Saunders-Smits, G. N., & Groen, P. (2021). Testing the Validity and Reliability of an Instrument Measuring Engineering Students' Perceptions of Transversal Competency Levels. IEEE Transactions on Education, 64(2), 180–186. https://doi.org/10.1109/TE.2020.3025378

Dalati, S. (2018). Measurement and Measurement Scales BT - Modernizing the Academic Teaching and Research Environment: Methodologies and Cases in Business Research (J. Marx Gómez & S. Mouselli (eds.); pp. 79–96). Springer International Publishing. https://doi.org/10.1007/978-3-319-74173-4_5

Ediyanto, E., Sunandar, A., Ramadhani, R. S., & Aqilah, T. S. (2022). Sustainable Instrument Development in Educational Research. Discourse and Communication for Sustainable Education, 13(1), 37–47. https://doi.org/doi:10.2478/dcse-2022-0004

Efstathiou, G. (2019). Translation, Adaptation and Validation Process of Research Instruments BT - Individualized Care: Theory, Measurement, Research and Practice (R. Suhonen, M. Stolt, & E. Papastavrou (eds.); pp. 65–78). Springer International Publishing. https://doi.org/10.1007/978-3-319-89899-5_7

Eisend, M., & Kuss, A. (2019). Obtaining Data for Theory Testing: Operationalization, Measurement, and Data Collection BT - Research Methodology in Marketing: Theory Development, Empirical Approaches and Philosophy of Science Considerations (M. Eisend & A. Kuss (eds.); pp. 123–150). Springer International Publishing. https://doi.org/10.1007/978-3-030-10794-9_6

Fávero, L. P., Belfiore, P., & de Freitas Souza, R. (2023). Chapter 3 - Types of variables, measurement scales, and accuracy scales* (L. P. Fávero, P. Belfiore, & R. B. T.-D. S. de Freitas Souza Analytics and Machine Learning with R (eds.); pp. 29–36). Academic Press. https://doi.org/https://doi.org/10.1016/B978-0-12-824271-1.00001-9

Fenn, J., Tan, C.-S., & George, S. (2020). Development, validation and translation of psychological tests. BJPsych Advances, 26(5), 306–315. https://doi.org/DOI: 10.1192/bja.2020.33

Flannelly, L. T., Flannelly, K. J., & Jankowski, K. R. B. (2014). Independent, Dependent, and Other Variables in Healthcare and Chaplaincy Research. Journal of Health Care Chaplaincy, 20(4), 161–170. https://doi.org/10.1080/08854726.2014.959374

Gärtner, F. R., Bomhof-Roordink, H., Smith, I. P., Scholl, I., Stiggelbout, A. M., & Pieterse, A. H. (2018). The quality of instruments to assess the process of shared decision making: A systematic review. In PLoS ONE (Vol. 13, Issue 2). https://doi.org/10.1371/journal.pone.0191747

Gregory, R. J. (2015). Psychological Testing:History, Principles, and Applications (7th ed.). Pearson Education Limited.

Gross, A. L., Chu, N., Anderson, L., Glymour, M. M., Jones, R. N., & Diseases, C. A. M. (2018). Do people with Alzheimer's disease improve with repeated testing? Unpacking the role of content and context in retest effects. Age and Ageing, 47(6), 866–871. https://doi.org/10.1093/ageing/afy136

Heale, R., & Twycross, A. (2015). Validity and reliability in quantitative studies. Evidence-Based Nursing, 18(3), 66–67. https://doi.org/10.1136/eb-2015-102129

Hidayat, A. A. (2021). Menyusun instrumen penelitian dan uji validitas-reliabilitas. Health Books Publishing.

Holton III, E. F., Bates, R. A., Seyler, D. L., & Carvalho, M. B. (1997). Toward construct validation of a transfer climate instrument. Human Resource Development Quarterly, 8(2), 95–113. https://doi.org/https://doi.org/10.1002/hrdq.3920080203

Jin, S., Noh, M., Yang-Wallentin, F., & Lee, Y. (2021). Robust nonlinear structural equation modeling with interaction between exogenous and endogenous latent variables. Structural Equation Modeling: A Multidisciplinary Journal, 28(4), 547–556. https://doi.org/10.1080/10705511.2020.1857255

Kimberlin, C. L., & Winterstein, A. G. (2008). Validity and reliability of measurement instruments used in research. American Journal of Health-System Pharmacy, 65(23), 2276–2284. https://doi.org/10.2146/ajhp070364

Kittur, J. (2023). Conducting Quantitative Research Study: A Step-by-Step Process. Journal of Engineering Education Transformations, 36(4), 100–112. https://doi.org/10.16920/jeet/2023/v36i4/23120

Lane, S., & Pérez, A. (2023). Validity (R. J. Tierney, F. Rizvi, & K. B. T.-I. E. of E. (Fourth E. Ercikan (eds.); pp. 35–44). Elsevier. https://doi.org/https://doi.org/10.1016/B978-0-12-818630-5.10005-3

Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563–575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x

Little, T. D., Stickley, Z. L., Rioux, C., & Wu, W. (2024). Quantitative research methods (W. Troop-Gordon & E. W. B. T.-E. of A. (Second E. Neblett (eds.); pp. 403–417). Academic Press. https://doi.org/https://doi.org/10.1016/B978-0-323-96023-6.00095-6

Liu, S., Xu, S., Li, Q., Xiao, H., & Zhou, S. (2023). Development and validation of an instrument to assess students' science, technology, engineering, and mathematics identity. Physical Review Physics Education Research, 19(1), 10138. https://doi.org/10.1103/PhysRevPhysEducRes.19.010138

Miksza, P., Shaw, J. T., Kapalka Richerme, L., Hash, P. M., Hodges, D. A., & Cassidy Parker, E. (2023). 309Measurement. In P. Miksza, J. T. Shaw, L. Kapalka Richerme, P. M. Hash, & D. A. Hodges (Eds.), Music Education Research: An Introduction (p. 0). Oxford University Press. https://doi.org/10.1093/oso/9780197639757.003.0015

Mthembu, P. (2018). Methodology and the Operationalisation of Variables BT - China and India's Development Cooperation in Africa: The Rise of Southern Powers (P. Mthembu (ed.); pp. 75–110). Springer International Publishing. https://doi.org/10.1007/978-3-319-69502-0_5

Nermend, K. (2023). Initial Procedure for Data Analysis BT - Multi-Criteria and Multi-Dimensional Analysis in Decisions : Decision Making with Preference Vector Methods (PVM) and Vector Measure Construction Methods (VMCM) (K. Nermend (ed.); pp. 37–94). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-40538-9_2

Oluwatayo, J. A. (2012). Validity and Reliability Issues in Educational Research. Journal of Educational and Social Research, 2(May), 391–400. https://doi.org/10.5901/jesr.2012.v2n2.391

Peeters, M. J., & Harpe, S. E. (2020). Updating conceptions of validity and reliability. Research in Social and Administrative Pharmacy, 16(8), 1127–1130. https://doi.org/https://doi.org/10.1016/j.sapharm.2019.11.017

Pelletier, J. A., & Sharma, N. (2015). Investigating the Impact of Student Samples on Data Quality and Research Outcomes BT - Ideas in Marketing: Finding the New and Polishing the Old (K. Kubacki (ed.); p. 230). Springer International Publishing.

Pittman, J., & Bakas, T. (2010). Measurement and Instrument Design. Journal of Wound Ostomy & Continence Nursing, 37(6). https://journals.lww.com/jwocnonline/fulltext/2010/11000/measurement_and_instrument_design.8.aspx

Ramadhan, M. F., Siroj, R. A., & Afgani, M. W. (2024). Validitas and Reliabilitas. Journal on Education, 6(2), 10967–10975. https://doi.org/10.31004/joe.v6i2.4885

Rossi, J. S., & Merenda, P. F. (2010). Variables in Research. In The Corsini Encyclopedia of Psychology (pp. 1–2). https://doi.org/https://doi.org/10.1002/9780470479216.corpsy1020

Salmia, S. S. (2023). Development of Quality Instruments and Data Collection Techniques. Jurnal Pendidikan Dan Pengajaran Guru Sekolah Dasar (JPPGuseda), 6(1), 119–124. https://doi.org/10.55215/jppguseda.v6i1.7527

Selvi, H., & Özge, A. (2023). Reliability and Validity of Clinical Scales Measurement BT - Clinical Scales for Headache Disorders (P. Yalınay Dikmen & A. Özge (eds.); pp. 45–60). Springer International Publishing. https://doi.org/10.1007/978-3-031-25938-8_3

Slife, B. D., Wright, C. D., & Yanchar, S. C. (2016). Using Operational Definitions in Research: A Best-Practices Approach. The Journal of Mind and Behavior, 37(2), 119–139. http://www.jstor.org/stable/44631540

Stanger, N., Whitaker, L., & Backhouse, S. H. (2020). Testing the validity and reliability of the doping willingness in sport scale. Scandinavian Journal of Medicine and Science in Sports, 30(8), 1529–1543. https://doi.org/10.1111/sms.13683

Stocker, M., Darroch, L., Krahl, R., Habermann, T., Devaraju, A., Schwardmann, U., D’onofrio, C., & Häggström, I. (2020). Persistent identification of instrument. Data Science Journal, 19(1), 1–12. https://doi.org/10.5334/dsj-2020-018

Stuart, E. A., Ackerman, B., & Westreich, D. (2017). Generalizability of Randomized Trial Results to Target Populations: Design and Analysis Possibilities. Research on Social Work Practice, 28(5), 532–537. https://doi.org/10.1177/1049731517720730

Subhaktiyasa, P. G. (2024a). Menentukan Populasi dan Sampel: Pendekatan Metodologi Penelitian Kuantitatif dan Kualitatif. Jurnal Ilmiah Profesi Pendidikan.

Subhaktiyasa, P. G. (2024b). PLS-SEM for Multivariate Analysis: A Practical Guide to Educational Research using SmartPLS. EduLine: Journal of Education and Learning Innovation, 4(3). https://doi.org/https://doi.org/10.35877/454RI.eduline2861

Subhaktiyasa, P. G., Agung, A. A. G., Jampel, I. N., & Dantes, K. R. (2024). Spiritual Leadership and Lecturer Performance: Mediating Role of Work Motivation. International Journal of Evaluation and Research in Education, 13(6), 3653~3662. https://doi.org/10.11591/ijere.v13i6.29175

Subhaktiyasa, P. G., Andriana, K. R. F., Sintari, S. N. N., Shinta, W., Sumaryani, N. P., & Lede, Y. U. (2023). The Effect of Transformational Leadership, Servant Leadership, and Spiritual Leadership on Organizational Citizenship Behavior. Jurnal Organisasi Dan Manajemen, 19(1), 224–238. https://doi.org/10.33830/jom.v19i1.3695.2023

Subhaktiyasa, P. G., & Sintari, S. N. N. (2024). Elevating Performance : Spiritual Leadership and Mitigation of Counterproductive Work Behavior in Higher Education. Indonesian Journal of Educational Research and Review, 7(2). https://doi.org/10.23887/ijerr.v7i2.76966

Subhaktiyasa, P. G., Sintari, S. N. N., Andriana, K. R. F., Sumaryani, N. P., Werang, B. W., & Sudiarta, I. N. (2024). Tri Hita Karana and Organizational Culture in Society 5.0: Effect on Adaptability, Consistency, Involvement, and Mission. Jurnal Ilmiah Manajemen Dan Bisnis, 9(1), 1–10. https://doi.org/https://doi.org/10.38043/jimb. v7i2.4679

Subhaktiyasa, P. G., Sutrisna, I. G. P. A. F., Sumaryani, N. P., & Sunita, N. W. (2024). Entrepreneurial Intentions among Medical Laboratory Technology Students : Effect of Education and Self-Efficacy. Journal of Education and Learning, 18(3), 719–726. https://doi.org/https://doi.org/10.11591/edulearn.v18i3.21467

Sugiono. (2021). Metode Penelitian Kuantitatif, Kualitatif, dan R&D (2nd ed.). Alfabeta.

Taherdoost, H. (2017). Validity and Reliability of the Research Instrument ; How to Test the Validation of a Questionnaire / Survey in a Researchfile. International Journal of Academic Research in Management, 5(3), 27–36. https://hal.science/hal-02546799/document

Thomas, S. (2022). Robert F. DeVellis & Carolyn T. Thorpe. (2022) Scale development: Theory and applications. California: SAGE Publications, Inc., 320 pages, $60.00 softcover. Personnel Psychology, 75(1), 243–244. https://doi.org/https://doi.org/10.1111/peps.12499

Thompson, B., & Daniel, L. G. (1996). Factor Analytic Evidence for the Construct Validity of Scores: A Historical Overview and Some Guidelines. Educational and Psychological Measurement, 56(2), 197–208. https://doi.org/10.1177/0013164496056002001

Turcios, M. E., Agarwal, N., & Watkins, L. (2012). Library & information science literature: How much of it is research? Proceedings of the American Society for Information Science and Technology, 49(1), 1–4. https://doi.org/https://doi.org/10.1002/meet.14504901320

Wang, R., & Krosnick, J. A. (2020). Middle alternatives and measurement validity: a recommendation for survey researchers. International Journal of Social Research Methodology, 23(2), 169–184. https://doi.org/10.1080/13645579.2019.1645384

Winkler, C. E., & Berenbon, R. F. (2021). Validation of a survey for measuring scientists' attitudes toward data reuse. Journal of the Association for Information Science and Technology, 72(4), 449–453. https://doi.org/https://doi.org/10.1002/asi.24412

Yusup, F. (2018). Uji Validitas dan Reliabilitas Instrumen Penelitian Kuantitatif. Jurnal Tarbiyah: Jurnal Ilmiah Kependidikan, 7(1), 17–23. https://doi.org/10.21831/jorpres.v13i1.12884