Evaluation of the content validity of the intrinsic-instrumental assessment tool for assessing the nature values of constructed wetlands
Abstract
Constructed wetlands possess tremendous nature values, namely instrumental and intrinsic values. Constructed wetlands also store and capture carbon which help to mitigate climate change in sustaining our earth system. Hence, sound management of constructed wetlands must consider its importance as essential assets that increase their resilience in mitigation and adaptation strategies towards adverse effects of climate change. To examine the vital value of constructed wetlands, this study attempts to evaluate the content validity of the developed Intrinsic-Instrument Assessment (IIA) tool for assessing the nature values of constructed wetlands in the context of climate change. A methodological study was conducted to evaluate the content validity of the IIA tool in two-phases. First, a comprehensive literature review was conducted at the development phase to identify the construct and dimension, generate items and instrument formation. In the second phase (evaluation), a committee of six experts performed the content validity evaluation, and the content validity index was implemented for content validity quantification. Finally, the researcher conducted a discussion between the team members to finalise the items of the IIA tool. The first version of the IIA tool identified three domains (instrumental, objective and intrinsic values) with 36 items. The item content validity index (I-CVI) ranges from 0.833 to 1. The overall content validity index using the average approach, the scale content validity index (S-CVI/Ave) is 0.97. Thus, the IIA tool was evaluated with highly relevant and excellent content validity. Researchers generated 17 additional items in the IIA version 2.0 after considering experts’ feedback. Still, after the second evaluation by researchers, the final version of the IIA tool consists of 42 items. This paper contributes to the body of knowledge by performing the systematic process of the essential steps to verify the developed instrument’s reliability and validity, especially in the field of socio-ecology. This study provides comprehensive information and example as guidance for evaluating content validity for a new instrument scale. Also, it helps to bring insight into constructed wetlands’ vital nature values as the nature solution in mitigating and adapting climate change to advocate the sustainable development of constructed wetlands ecosystems.
Keywords
Full Text:
PDFReferences
Ahmad, T., Ahmad, K. & Alam, M. (2016). Sustainable management of water treatment sludge
through 3‘R’ concept. Journal of Cleaner Production 124: 1–13. doi:10.1016/j.jclepro.2016.02.073
Akhir, M. S. A., Amir, A. A., Mokhtar, M. & Hooi, A. W. K. (2016). Constructed wetland for
wastewater treatment : A case study at Frangipani Resort, Langkawi. International Journal of the Malay World and Civilisation 4(1): 21–28.
Arias-Arévalo, P., Martín-López, B. & Gómez-Baggethun, E. (2017). Exploring intrinsic, instrumental, and relational values for sustainable management of social-ecological systems. Ecology and Society 22(4): art43. doi:10.5751/ES-09812-220443
Bernal, B. & Mitsch, W. J. (2014). Carbon Sequestration in two created riverine wetlands in the Midwestern United States. Journal of Environmental Quality 42: 1236–1244. doi:10.2134/jeq2012.0229
Clarens, A. F. & Peters, C. A. (2016). Mitigating climate change at the carbon water nexus: A call to action for the environmental engineering community. Environmental Engineering Science 33(10): 719–724. doi:10.1089/ees.2016.0455
de Klein, J. J. M. & van der Werf, A. K. (2014). Balancing carbon sequestration and GHG emissions in a constructred wetland. Ecological Engineering 66: 36–42.
Dunlap, R. E., Van Liere, K. D., Mertig, A. G. & Jones, R. E. (2000). New trends in measuring environmental attitudes: Measuring endorsement of the new ecological paradigm: A revised NEP scale. Journal of Social Issues 56(3): 425–442. doi:10.1111/0022-4537.00176
Field, A., Miles, J. & Field, Z. (2012). Discovering statistics using R. SAGE Publications.
Gómez-Baggethun, E., Martín-López, B., Barton, D., Braat, L., Saarikoski, H., Kelemen, E., García-Llorente, M., et al. (2014). State-of-the-art report on integrated valuation of ecosystem services. European Commission FP7 (July): 33.
Gómez-Baggethun, Erik & Barton, D. N. (2013). Classifying and valuing ecosystem services for urban planning. Ecological Economics 86: 235–245. doi:10.1016/j.ecolecon.2012.08.019
Grant, J. S. & Davis, L. L. (1997.) Selection and use of content experts for instrument development. Research in Nursing & Health 20(3): 269–274. doi:10.1002/(SICI)1098-240X(199706)20:3<269::AID-NUR9>3.3.CO;2-3
Haddaway, N. R., Macura, B., Whaley, P. & Pullin, A. S. (2018). ROSES Reporting standards for systematic evidence syntheses: Pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps. Environmental Evidence 7(1): 4–11. doi:10.1186/s13750-018-0121-7
Justus, J., Colyvan, M., Regan, H. & Maguire, L. (2009). Buying into conservation: intrinsic versus instrumental value. Trends in Ecology and Evolution 24(4): 187–191. doi:10.1016/j.tree.2008.11.011
Ku, L. & Zaroff, C. (2014). How far is your money from your mouth? The effects of intrinsic relative to extrinsic values on willingness to pay and protect the environment. Journal of Environmental Psychology 40: 472–483. doi:10.1016/j.jenvp.2014.10.008
Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research 35(6): 382–386.
Masi, F., Rizzo, A. & Regelsberger, M. (2018). The role of constructed wetlands in a new circular economy, resource oriented, and ecosystem services paradigm. Journal of Environmental Management 216: 275–284. doi:10.1016/j.jenvman.2017.11.086
Masuwai, A., Tajudin, M. & Saad, N. S. (2016). Evaluating the face and content validity of a teaching and learning guiding principles instrument (TLGPI): A perspective study of Malaysian teacher educators. Geografia : Malaysian Journal of Society and Space 12(3): 11–21.
Mayer, F. S. & Frantz, C. M. P. (2004). The connectedness to nature scale: A measure of individuals’ feeling in community with nature. Journal of Environmental Psychology 24(4): 503–515. doi:10.1016/j.jenvp.2004.10.001
McCormick, M., Bielefeldt, A. R., Swan, C. W. & Paterson, K. G. (2015). Assessing students’ motivation to engage in sustainable engineering. International Journal of Sustainability in Higher Education 16(2): 136–154. doi:10.1108/IJSHE-06-2013-0054
Millennium Ecosystem Assessment, (MEA) (2005). Ecosystems and Human Well-being wetlands and water - Synthesis. World Resources Institute, Washington, DC. pp: 2
Mitsch, W. J., Bernal, B. & Hernandez, M. E. (2015). Ecosystem services of wetlands. International Journal of Biodiversity Science, Ecosystem Services and Management 11(1): 1–4. doi:10.1080/21513732.2015.1006250
Mitsch, W. J., Zhang, L., Waletzko, E. & Bernal, B. (2014). Validation of the ecosystem services of created wetlands: Two decades of plant succession, nutrient retention, and carbon sequestration in experimental riverine marshes. Ecological Engineering 72: 11–24. doi:10.1016/j.ecoleng.2014.09.108
Papias, S., Masson, M., Pelletant, S., Prost-Boucle, S. & Boutin, C. (2018). In situ continuous monitoring of nitrogen with ion-selective electrodes in a constructed wetland receiving treated wastewater: An operating protocol to obtain reliable data. Water Science and Technology 77(6): 1706–1713. doi:10.2166/wst.2018.052
Pascual, U., Balvanera, P., Díaz, S., Pataki, G., Roth, E., Stenseke, M., Watson, R. T., et al. (2017). Valuing nature’s contributions to people: the IPBES approach. Current Opinion in Environmental Sustainability 26–27: 7–16. doi:10.1016/j.cosust.2016.12.006
Polit, D. F. & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Research in Nursing & Health 29: 489–497. doi:10.1002/nur
Reddy, G. B., Raczkowski, C. W., Cyrus, J. S. & Szogi, A. (2016). Carbon sequestration in a surface flow constructed wetland after 12 years of swine wastewater treatment. Water Science and Technology 73(10): 2501–2508. doi:10.2166/wst.2016.112
Rooney, R. C., Foote, L., Krogman, N., Pattison, J. K., Wilson, M. J. & Bayley, S. E. (2015). Replacing natural wetlands with stormwater management facilities: Biophysical and perceived social values. Water Research 73: 17–28. doi:10.1016/j.watres.2014.12.035
Rosli, F. A., Lee, K. E., Goh, C. T., Mokhtar, M., Latif, M. T., Goh, T. L., & Simon, N. (2017). The Use of Constructed Wetlands in Sequestrating Carbon: An Overview. Nature Environment & Pollution Technology, 16(3): 813-819.
Rossa, L., Urbaniak, M. & Majewska, Z. (2019). Application of constructed wetland for treating runoff from the dairy cattle farm yard. Journal of Ecological Engineering 20(10): 225–232. doi:10.12911/22998993/113421
Rubio, D. M. G., Berg-Weger, M., Tebb, S. S., Lee, E. S. & Rauch, S. (2003). Objectifyng content validity: Conducting a content validity study in social work research. Social Work Research 27(2): 94–104. doi:10.1093/swr/27.2.94
Sandler, R. (2012). Intrinsic value, ecology, and conservation. Nature Education Knowledge 3(10): 4.
Schultz, P. W. (2002). Inclusion with nature: The psychology of human-nature relations. Psychology of Sustainable Development 61–78. doi:10.1007/978-1-4615-0995-0_4
Sherren, K. & Verstraten, C. (2013). What can photo-elicitation tell us about how maritime farmers perceive wetlands as climate changes? Wetlands 33(1): 65–81. doi:10.1007/s13157-012-0352-2
Shrotryia, V. K. & Dhanda, U. (2019). Content validity of assessment instrument for employee engagement. SAGE Open 9(1): 1–7. doi:10.1177/2158244018821751
Sidek, N. M., Abdullah, S. R. S., Ahmad, N. ‘Uyun, Draman, S. F. S., Rosli, M. M. M. & Sanusi, M. F. (2018). Phytoremediation of abandoned mining lake by Water Hyacinth and Water Lettuce in constructed wetlans. Jurnal Teknologi 80(5): 87–93.
Silva, D. F. O., de Sales Souza, A. L., Pimentel, J. B., Souza, T. O., dos Santos Araújo, E. P., Sena-Evangelista, K. C. M., Arrais, R. F., et al. (2020). Development and content validity of an instrument for assessing the motivation for weight loss in adolescents with overweight and obesity. PLoS ONE 15: 1–13. doi:10.1371/journal.pone.0242680
Stumpner, E. B., Kraus, T. E. C., Liang, Y. L., Bachand, S. M., Horwath, W. R. & Bachand, P. A. M. (2018). Sediment accretion and carbon storage in constructed wetlands receiving water treated with metal-based coagulants. Ecological Engineering 111: 176–185. doi:10.1016/j.ecoleng.2017.10.016
Taherdoost, H. (2016). Validity and reliability of the research instrument; How to test the Validation of a questionnaire/survey in a research. SSRN Electronic Journal 5(3): 28–36. doi:10.2139/ssrn.3205040
Tang, K. H. D. (2018). Correlation between sustainability education and engineering students’ attitudes towards sustainability. International Journal of Sustainability in Higher Education 19(3): 459–472. doi:10.1108/IJSHE-08-2017-0139
Villa, J. A. & Bernal, B. (2018). Carbon sequestration in wetlands, from science to practice: An overview of the biogeochemical process, measurement methods, and policy framework. Ecological Engineering 114: 115–128. doi:10.1016/j.ecoleng.2017.06.037
Waltz, C. F., Strickland, O. L. & Lenz, E. R. (2010). Measurement in nursing and health research, hlm. Fourth Edi. Springer Publishing Company.
Were, D., Kansiime, F., Fetahi, T., Cooper, A. & Jjuuko, C. (2019). Carbon sequestration by wetlands: A critical review of enhancement measures for climate change mitigation. Earth Systems and Environment 3(2): 327–340. doi:10.1007/s41748-019-00094-0
White, J. & Simon, M. K. (2016). Survey/interview validation rubric for an expert panel -VREP. Ebook Reviewer. http://www.dissertationrecipes.com/
Winter, C. & Lockwood, M. (2004). The natural area value scale: A new instrument for measuring natural area values. Australasian Journal of Environmental Management 11(1): 11–20. doi:10.1080/14486563.2004.10648594
Winter, C. & Lockwood, M. (2005). A model for measuring natural area values and park preferences. Environmental Conservation 32(3): 270–278.
Yusoff, M. S. B. (2019). ABC of content validation and content validity index calculation. Education in Medicine Journal 11(2): 49–54. doi:10.21315/eimj2019.11.2.6
Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H. & Nikanfar, A.-R. (2015). Design and implementation content validity study: Development of an instrument for measuring patient-centered communication. Journal of Caring Sciences 4(2): 165–178. doi:10.15171/jcs.2015.017