Measuring Sustainability Literacy: Scale Development and Validation

Karimi, Abdul Hakim (2024): Measuring Sustainability Literacy: Scale Development and Validation.

Abstract

Concerns have been raised after recent reports from the United Nations and Higher Education Sustainability Initiative showed a lower score in sustainability literacy of people. Among other things, these reports show that educational practices are not effective enough to inform and educate people about sustainability. Thus, an effective assessment of the sustainability literacy of a society can be a turning point and will tremendously help in improving sustainability literacy. In recent years, different researchers tried to develop tools to measure sustainability literacy, however, most of the research focused on specific or limited dimensions of sustainability literacy such as environment or society, and lacked inclusivity. Thus, in this study, we aimed to develop a tool that can measure sustainability literacy holistically. We developed the scale under the UNESCO framework of Sustainable Development and used the existing literature and focus group recommendations to generate items for the scale. The methodology used in the paper involved Exploratory Factor Analysis (EFA) followed by the reliability analysis of the developed scale. The sample size of the data was 172 individuals. The EFA and reliability results indicate that the developed scale is strongly valid and highly reliable and can be used to measure sustainability literacy holistically.

• Item Type: MPRA Paper
• Language: English
• Keywords: Sustainability Literacy Sustainability measurement Scale Development and Validation
• Subjects: M - Business Administration and Business Economics ; Marketing ; Accounting ; Personnel Economics > M1 - Business Administration > M16 - International Business Administration; Q - Agricultural and Natural Resource Economics ; Environmental and Ecological Economics > Q0 - General > Q01 - Sustainable Development

References

Aginako, Z., Begoña Peña-Lang, M., Bedialauneta, M. T., & Guraya, T. (2021). Analysis of the validity and reliability of a questionnaire to measure students’ perception of inclusion of sustainability in engineering degrees. International Journal of Sustainability in Higher Education, 22(6), 1402–1420. https://doi.org/10.1108/ijshe-09-2020-0355

Aginako, Z., & Guraya, T. (2021). Students’ Perception about Sustainability in the Engineering School of Bilbao (University of the Basque Country): Insertion Level and Importance. Sustainability, 13(15), 8673. https://doi.org/10.3390/su13158673

Akeel, U., Bell, S., & Mitchell, J. E. (2019). Assessing the sustainability literacy of the Nigerian engineering community. Journal of Cleaner Production, 212(1), 666–676. https://doi.org/10.1016/j.jclepro.2018.12.089

Aleixo, A. M., Leal, S., & Azeiteiro, U. M. (2021). Higher education students’ perceptions of sustainable development in Portugal. Journal of Cleaner Production, 327(1), 129429. https://doi.org/10.1016/j.jclepro.2021.129429

Allen, C., & Clouth, S. (2012). Green economy, green growth, and low-carbon development – history, definitions and a guide to recent publications. UNDESA: A guidebook to the Green Economy. (Retrieved January 15, 2024, from https://sustainabledevelopment.un.org/content/documents/GE%20Guidebook.pdf)

Atabek-Yiğit, E., Köklükaya, N., Yavuz, M., & Demirhan, E. (2014). DEVELOPMENT AND VALIDATION OF ENVIRONMENTAL LITERACY SCALE FOR ADULTS (ELSA). Journal of Baltic Science Education, 13(3), 425–435. https://doi.org/10.33225/jbse/14.13.425

Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Prentice-Hall.

Basiago, A. D. (1996). The search for the sustainable city in 20th century urban planning. The Environmentalist, 16(2), 135–155. https://doi.org/10.1007/bf01325104

Basiago, A. D. (1999). Economic, social, and environmental sustainability in development theory and urban planning practice. The Environmentalist, 19, 145–161. https://www.amherst.edu/system/files/media/0972/fulltext.pdf

Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer. Frontiers in Public Health, 6(149). https://doi.org/10.3389/fpubh.2018.00149

Bonnett, M. (1999). Education for Sustainable Development: a coherent philosophy for environmental education? Cambridge Journal of Education, 29(3), 313–324. https://doi.org/10.1080/0305764990290302

Brundtland, G.H. (1987) Our Common Future: Report of the World Commission on Environment and Development. Geneva, UN-Dokument A/42/427.http://www.un-documents.net/ocf-ov.htm

Calder, W., & Cligston, R. (2005). Education for a Sustainable Future. Journal of Geography in Higher Education, 29(1), 7–12. https://doi.org/10.1080/03098260500030231

Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105. https://doi.org/10.1037/h0046016

Caradonna, J. L. (2014). Sustainability: A History. In Google Books. Oxford University Press. https://books.google.de/books?id=GGrrAwAAQBAJ&authuser=2&source=gbs_navlinks_s

Christenson, N., Chang Rundgren, S.-N., & Höglund, H.-O. (2011). Using the SEE-SEP Model to Analyze Upper Secondary Students’ Use of Supporting Reasons in Arguing Socioscientific Issues. Journal of Science Education and Technology, 21(3), 342–352. https://doi.org/10.1007/s10956-011-9328-x

Chu, H., Lee, E. A., Ryung Ko, H., Hee Shin, D., Nam Lee, M., Mee Min, B., & Hee Kang, K. (2007). Korean Year 3 Children’s Environmental Literacy: A prerequisite for a Korean environmental education curriculum. International Journal of Science Education, 29(6), 731–746. https://doi.org/10.1080/09500690600823532

Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309–319. https://doi.org/10.1037/1040-3590.7.3.309

Cooper, P. J., & Vargas, C. M. (2004). Implementing Sustainable Development: From Global Policy to Local Action. In Google Books. Rowman & Littlefield Publishers. https://books.google.de/books?hl=en&lr=&id=0b0cAAAAQBAJ&oi=fnd&pg=PR1&ots=ltQGXcDgDw&sig=g4OxQ2_JWzODSuuto5hL1efAUmg&redir_esc=y#v=onepage&q&f=false

Cortese, A. (2003). The Critical Role of Higher Education in Creating a Sustainable Future. Planning for Higher Education, 31(3), 15–22. https://www.redcampussustentable.cl/wp-content/uploads/2022/07/6-CorteseCriticalRoleOfHE.pdf

Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98–104. https://doi.org/10.1037/0021-9010.78.1.98

Courtenay-Hall, P., & Rogers, L. (2002). Gaps in Mind: Problems in environmental knowledge-behaviour modelling research. Environmental Education Research, 8(3), 283–297. https://doi.org/10.1080/13504620220145438

Coyle, K. (2005). Environmental Literacy in America: What Ten Years of NEETF/Roper Research and Related Studies Say about Environmental Literacy in the U.S. (Retrieved January 25, 2024, from https://files.eric.ed.gov/fulltext/ED522820.pdf)

Daly, H. E. (1992). U.N. conferences on environment and development: Retrospect on Stockholm and prospects for Rio. Ecological Economics, 5(1), 9–14. https://doi.org/10.1016/0921-8009(92)90018-n

Dernbach, J. C. (2003). Achieving Sustainable Development: The Centrality and Multiple Facets of Integrated Decisionmaking. Indiana Journal of Global Legal Studies, 10(1), 247. https://doi.org/10.2979/gls.2003.10.1.247

Devellis, R. F. (2017). Scale Development : Theory and Applications (4th ed.). SAGE Publications.

Dunlap, R. E., Van Liere, K. D., Mertig, A. G., & Jones, R. E. (2000). Measuring endorsement of the new ecological paradigm: A revised NEP scale. Journal of Social Issues, 56(3), 425–442. https://doi.org/10.1111/0022-4537.00176

Du, Q., & Kang, J. T. (2016). Tentative ideas on the reform of exercising state ownership of natural resources: Preliminary thoughts on establishing a state-owned natural resources supervision and administration commission. Jiangxi Social Science, 6, 160.

Eagly, A. H., & Chaiken, S. (1993). The psychology of attitudes. Harcourt Brace Jovanovich College Publishers.

Erdogan, M., & Ok, A. (2011). An Assessment of Turkish Young Pupils’ Environmental Literacy: A nationwide survey. International Journal of Science Education, 33(17), 2375–2406. https://doi.org/10.1080/09500693.2010.550653

Eriksson, M., & Rundgren, C.-J. (2012). Vargfrågan - Gymnasieelevers argumentation kring ett sociovetenskapligt dilemma. “The Wolf Issue - Upper Secondary Students’ Argumentation about a Socio-Scientific Issue.” Nordic Studies in Science Education, 8(1), 43–58. https://doi.org/10.5617/nordina.358

Evers, B. (2018). Why Adopt the Sustainable Development Goals?. Master Thesis Erasmus University Rotterdam. Public Administration. (Retrieved January 22, 2024, from http://hdl.handle.net/2105/41819)

Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.org/10.1037/1082-989x.4.3.272

Fadeeva, Z., & Mochizuki, Y. (2010). Higher education for today and tomorrow: university appraisal for diversity, innovation and change towards sustainable development. Sustainability Science, 5(2), 249–256. https://doi.org/10.1007/s11625-010-0106-0

Filho, W. L. (2011). About the Role of Universities and Their Contribution to Sustainable Development. Higher Education Policy, 24(4), 427–438. https://doi.org/10.1057/hep.2011.16

Giddings, B., Hopwood, B., & O’Brien, G. (2002). Environment, economy and society: fitting them together into sustainable development. Sustainable Development, 10(4), 187–196. https://doi.org/10.1002/sd.199

Glotzbach, S., & Baumgartner, S. (2012). The Relationship between Intragenerational and Intergenerational Ecological Justice. Environmental Values, 21(3), 331–355. https://doi.org/10.3197/096327112x13400390126055

Gray, R. (2010). Is accounting for sustainability actually accounting for sustainability…and how would we know? An exploration of narratives of organisations and the planet. Accounting, Organizations and Society, 35(1), 47–62. https://doi.org/10.1016/j.aos.2009.04.006

Green, S. B., & Salkind, N. J. (2014). Using SPSS for Windows and Macintosh : analyzing and understanding data. Pearson.

Guo, F. (2017). The spirit and characteristic of the general provisions of civil law. Law and Economics, 3, 5–16, 54.

Guterres, A. (2023, December 2). Secretary-General’s remarks at Global Climate Action High Level Event: Towards a Turning Point for Climate Action [as delivered] | United Nations Secretary-General. United Nations. (Retrieved January 10, 2023, from https://www.un.org/sg/en/content/sg/statement/2023-12-02/secretary-generals-remarks-global-climate-action-high-level-event-towards-turning-point-for-climate-action-delivered).

Hallinger, P., & Chatpinyakoop, C. (2019). A Bibliometric Review of Research on Higher Education for Sustainable Development, 1998–2018. Sustainability, 11(8), 2401. https://doi.org/10.3390/su11082401

Harvey, R. J., Billings, R. S., & Nilan, K. J. (1985). Confirmatory factor analysis of the Job Diagnostic Survey: Good news and bad news. Journal of Applied Psychology, 70(3), 461–468. https://doi.org/10.1037/0021-9010.70.3.461

Haws, K. L., Winterich, K. P., & Naylor, R. W. (2014). Seeing the world through GREEN-tinted glasses: Green consumption values and responses to environmentally friendly products. Journal of Consumer Psychology, 24(3), 336–354. https://doi.org/10.1016/j.jcps.2013.11.002

Hernández-Diaz, P. M., Polanco, J.-A., Escobar-Sierra, M., & Leal Filho, W. (2021). Holistic integration of sustainability at universities: Evidences from Colombia. Journal of Cleaner Production, 305(127145). https://doi.org/10.1016/j.jclepro.2021.127145

Hinkin, T. R. (1998). A Brief Tutorial on the Development of Measures for Use in Survey Questionnaires. Organizational Research Methods, 1(1), 104–121. https://doi.org/10.1177/109442819800100106

Hsu, S., & Roth, R. E. (1998). An Assessment of Environmental Literacy and Analysis of Predictors of Responsible Environmental Behaviour Held by Secondary Teachers in the Hualien Area of Taiwan. Environmental Education Research, 4(3), 229–249. https://doi.org/10.1080/1350462980040301

Husamah Husamah, Hadi Suwono, Nur, H., & Agus Dharmawan. (2022). The development and validation of environmental literacy instrument based on spirituality for prospective science teachers. Eurasia Journal of Mathematics, Science and Technology Education, 18(12), em2206–em2206. https://doi.org/10.29333/ejmste/12732

Jabareen, Y. (2006). A New Conceptual Framework for Sustainable Development. Environment, Development and Sustainability, 10(2), 179–192. https://doi.org/10.1007/s10668-006-9058-z

Jager, K. J., Zoccali, C., MacLeod, A., & Dekker, F. W. (2008). Confounding: What it is and how to deal with it. Kidney International, 73(3), 256–260. https://doi.org/10.1038/sj.ki.5002650

Kaiser, F. G., Oerke, B., & Bogner, F. X. (2007). Behavior-based environmental attitude: Development of an instrument for adolescents. Journal of Environmental Psychology, 27(3), 242–251. https://doi.org/10.1016/j.jenvp.2007.06.004

Kapitulčinová, D., AtKisson, A., Perdue, J., & Will, M. (2018). Towards integrated sustainability in higher education – Mapping the use of the Accelerator toolset in all dimensions of university practice. Journal of Cleaner Production, 172, 4367–4382. https://doi.org/10.1016/j.jclepro.2017.05.050

Khan, M. A. (1995). Sustainable development: The key concepts, issues and implications. Keynote paper given at the international sustainable development research conference, 27–29 march 1995, Manchester, UK. Sustainable Development, 3(2), 63–69. https://doi.org/10.1002/sd.3460030203

Koçoğlu, E., Egüz, Ş., Tösten, R., Demi̇F. B., & Tekdal, D. (2023). Perception of Ecological Literacy in Education: A Scale Development Study. International Journal of Education and Literacy Studies, 11(3), 3–9. https://doi.org/10.7575/aiac.ijels.v.11n.3p.3

Kolk, A. (2016). The social responsibility of international business: From ethics and the environment to CSR and sustainable development. Journal of World Business, 51(1), 23–34. https://doi.org/10.1016/j.jwb.2015.08.010

Kollmuss, A., & Agyeman, J. (2002). Mind the Gap: Why Do People Act Environmentally and What Are the Barriers to pro-environmental behavior? Environmental Education Research, 8(3), 239–260. https://doi.org/10.1080/13504620220145401

Kuehl, C., Sparks, A. C., Hodges, H., & Smith, E. R. A. N. (2021). The incoherence of sustainability literacy assessed with the Sulitest. Nature Sustainability, 4(6), 555–560. https://doi.org/10.1038/s41893-021-00687-6

Kyriazos, T. A., & Stalikas, A. (2018). Applied Psychometrics: The Steps of Scale Development and Standardization Process. Psychology, 09(11), 2531–2560. https://doi.org/10.4236/psych.2018.911145

Lamm, K., Lamm, A., & Edgar, D. (2020). Scale Development and Validation: Methodology and Recommendations. Journal of International Agricultural and Extension Education, 27(2), 24–35. https://doi.org/10.5191/jiaee.2020.27224

Leal Filho, W., Manolas, E., & Pace, P. (2008). Education for sustainable development: current discourses and practices and their relevance to technology education. International Journal of Technology and Design Education, 19(2), 149–165. https://doi.org/10.1007/s10798-008-9079-z

Leiserowitz, A., Smith, N. & Marlon, J.R. (2010) Americans’ Knowledge of Climate Change. Yale University. New Haven, CT: Yale Project on Climate Change Communication. https://climatecommunication.yale.edu/wpcontent/uploads/2016/02/2010_10_Americans%E2%80%99-Knowledge-of-Climate-Change.pdf (Accessed January 27, 2024)

Leiva-Brondo, M., Lajara-Camilleri, N., Vidal-Meló, A., Atarés, A., & Lull, C. (2022). Spanish University Students’ Awareness and Perception of Sustainable Development Goals and Sustainability Literacy. Sustainability, 14(8), 4552. https://doi.org/10.3390/su14084552

Lobo, M.-J., Pietriga, E., & Appert, C. (2015). An Evaluation of Interactive Map Comparison Techniques. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI ’15, 3573–3582. https://doi.org/10.1145/2702123.2702130

Lozano, R. (2018). Proposing a Definition and a Framework of Organisational Sustainability: A Review of Efforts and a Survey of Approaches to Change. Sustainability, 10(4), 1157. https://doi.org/10.3390/su10041157

Mansournia, M. A., Etminan, M., Danaei, G., Kaufman, J. S., & Collins, G. (2017). Handling time varying confounding in observational research. BMJ, 359(j4587). https://doi.org/10.1136/bmj.j4587

Mauch, C. (2014). The Growth of Trees: A Historical Perspective on Sustainability. German Council for Sustainable Development. https://www.carsoncenter.uni-muenchen.de/download/press/rcc-news/140805_mauch.pdf

Meadows, D. H., Randers, J., & Meadows, D. L. (2017). The Limits to Growth (1972). The Future of Nature, 101–116. https://doi.org/10.12987/9780300188479-012

Mebratu, D. (1998). Sustainability and sustainable development. Environmental Impact Assessment Review, 18(6), 493–520. https://doi.org/10.1016/s0195-9255(98)00019-5

Mensah, J. (2019). Sustainable development: Meaning, history, principles, pillars, and implications for human action: Literature review. Cogent Social Sciences, 5(1), 1–21. Tandfonline. https://doi.org/10.1080/23311886.2019.1653531

Michalos, A. C., Creech, H., McDonald, C., & Kahlke, P. M. H. (2010). Knowledge, Attitudes and Behaviours. Concerning Education for Sustainable Development: Two Exploratory Studies. Social Indicators Research, 100(3), 391–413. https://doi.org/10.1007/s11205-010-9620-9

Michalos, A. C., Creech, H., Swayze, N., Kahlke, P. M., Buckler, C., & Rempel, K. (2011, February). Measuring Knowledge, Attitudes and Behaviours Concerning Sustainable Development Among Tenth Grade Students in Manitoba. International Institute for Sustainable Development; IISD. https://www.iisd.org/publications/report/measuring-knowledge-attitudes-and-behaviours-concerning-sustainable-development

Michel, J. O., & Zwickle, A. (2021). The effect of information source on higher education students’ sustainability knowledge. Environmental Education Research, 27(7), 1080–1098. https://doi.org/10.1080/13504622.2021.1897527

Morgado, F. F. R., Meireles, J. F. F., Neves, C. M., Amaral, A. C. S., & Ferreira, M. E. C. (2017). Scale development: ten main limitations and recommendations to improve future research practices. Psicologia: Reflexão E Crítica, 30(1). https://doi.org/10.1186/s41155-016-0057-1

Müller-Christ, G., Sterling, S., van Dam-Mieras, R., Adomßent, M., Fischer, D., & Rieckmann, M. (2014). The role of campus, curriculum, and community in higher education for sustainable development – a conference report. Journal of Cleaner Production, 62, 134–137. https://doi.org/10.1016/j.jclepro.2013.02.029

Muñoz-Rodríguez, J. M., Sánchez-Carracedo, F., Barrón-Ruiz, Á., & Serrate-González, S. (2020). Are We Training in Sustainability in Higher Education? Case Study: Education Degrees at the University of Salamanca. Sustainability, 12(11), 4421. https://doi.org/10.3390/su12114421

Nolet, V. (2015). Educating for Sustainability: Principles and Practices for Teachers. Routledge. https://doi.org/10.4324/9781315867052

Olsson, D., Gericke, N., & Chang Rundgren, S.-N. . (2015). The effect of implementation of education for sustainable development in Swedish compulsory schools – assessing pupils’ sustainability consciousness. Environmental Education Research, 22(2), 176–202. https://doi.org/10.1080/13504622.2015.1005057

Orr, D. W. (1992). Ecological literacy : education and the transition to a postmodern world. State University Of New York Press. https://sunypress.edu/Books/E/Ecological-Literacy2

Ozdemir, O. (2021). A Scale Development Of The Sustainability Literacy. EDUCATION, SUSTAINABILITY & SOCIETY, 4(2), 66–72. https://doi.org/10.26480/ess.02.2021.66.72

Ozdemir, O. (2023). The Sustainability Literacy of Students: A Comparative Study between Turkey and the UK. Science Insights Education Frontiers, 17(2), 2693–2713. https://doi.org/10.15354/sief.23.or375

Pan, W.-L., Fan, R., Pan, W., Ma, X., Hu, C., Fu, P., & Su, J. (2023). The role of climate literacy in individual response to climate change: evidence from China. Journal of Cleaner Production, 405(136874). https://doi.org/10.1016/j.jclepro.2023.136874

Parkin, S., Johnston, A., Buckland, H., Brookes, F., & White, E. (2004). Learning and skills for sustainable development: Developing a sustainability literate society—Guidance for higher education institutions, London: Forum for the Future. (Retrieved January 4, 2024, from https://classdat.appstate.edu/FAA/TEC/balllf/Files%20for%20Benton/Articles/learningandskills.pdf)

Parkin, S., Johnston, D. A., Buckland, H., Brookes, F., & White, E. (2004). Guidance for Higher Education Institutions Learning and Skills for Sustainable Development Developing a sustainability literate society. HEPS. https://classdat.appstate.edu/FAA/TEC/balllf/Files%20for%20Benton/Articles/learningandskills.pdf. (Accessed January 21, 2024).

Peterson, R. A. (1994). A Meta-Analysis of Cronbach’s Coefficient Alpha. Journal of Consumer Research, 21(2), 381–391. https://www.jstor.org/stable/2489828

Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003). Common Method Biases in Behavioral research: a Critical Review of the Literature and Recommended remedies. Journal of Applied Psychology, 88(5), 879–903.

Potter-Nelson, E. M. (2020). Sustainability Literacy Competencies in Coursework for Preservice Teacher Preparation. Minds.wisconsin.edu. http://digital.library.wisc.edu/1793/80656

Raj, R., & Musgrave, J. (2014). Event Management and Sustainability. CABI. http://sherekashmir.informaticspublishing.com/776/1/9781845935245.pdf

Retchless, D. P., & Brewer, C. A. (2015). Guidance for representing uncertainty on global temperature change maps. International Journal of Climatology, 36(3), 1143–1159. https://doi.org/10.1002/joc.4408

Roth, C. (1992). Environmental Literacy: Its Roots, Evolution and Directions in the 1990s. In ERIC. ERIC Clearinghouse for Science, Mathematics, and Environmental Education. https://eric.ed.gov/?id=ED348235

Rothman, K. J., Greenland, S., & Lash, T. L. (2008). Modern Epidemiology. Wolters Kluwer / Lippincott Williams & Wilkins. https://students.aiu.edu/submissions/profiles/resources/onlineBook/a9c7D5_Modern_Epidemiology_3.pdf

Sánchez-Carracedo, F., Segalas, J., Vidal, E., Carracedo, F., Segalàs, J., Martin, C., Climent, J., López, D., & Cabré, J. (2018). Improving Engineering Educators’ Sustainability Competencies by using Competency Maps. The EDINSOST Project. https://www.researchgate.net/publication/329151613. (Accessed January 27, 2024).

Sandell, K., ÖhmanJ., & ÖstmanL. (2005). Education for sustainable development : nature, school and democracy. Lund Studentlitteratur. https://www.researchgate.net/publication/254558701_Education_for_Sustainable_Development_Nature_School_and_Democracy

Sandri, O. (2014). ‪Good practice learning and teaching for sustainability in higher education‬. Google Scholar. https://scholar.google.com/citations?view_op=view_citation&hl=en&user=dFu7WvQAAAAJ&citation_for_view=dFu7WvQAAAAJ:qjMakFHDy7sC‬‬‬‬

Saylan, C., Blumstein, D. T., & Ebrary, I. (2011). The failure of environmental education (and how we can fix it). University Of California Press.

Sekhar, C., & Raina, R. (2021). Towards more sustainable future: assessment of sustainability literacy among the future managers in India. Environment, Development and Sustainability, 23(1), 15830–15856. https://doi.org/10.1007/s10668-021-01316-0

Simmons, D. (1995). Developing a framework for national environmental education standards. Working paper no. 2: Papers on the Development of Environmental Education Standards (pp. 53–58). Troy, OH: NAAEE.

Stables, A., & Bishop, K. (2001). Weak and Strong Conceptions of Environmental Literacy: Implications for environmental education. Environmental Education Research, 7(1), 89–97. https://doi.org/10.1080/13504620125643

Sterling, S. (2020). Higher Education, Sustainability, and the Role of Systemic Learning. Higher Education and the Challenge of Sustainability, 49–70. https://doi.org/10.1007/0-306-48515-x_5

Stibbe, A., & Luna, H. (2009). The Handbook of Sustainability Literacy (pp. 10–16). Bloomsbury Publishing. https://sustainability.glos.ac.uk/wp-content/uploads/2017/07/Handbk-Sustainability-literacy-EC-16092020.pdf. (Accessed January 21, 2024).

Sulitest. (2023a). Advancing Sustainability Literacy For The Global Goals. 2023 Report from the Sulitest Movement, a tangible implementation of the HESI & a contributor to the review of the 2030 Agenda. Sulitest. https://assets-global.website-files.com/65280e69dc36aa08d8c6a40e/65280e69dc36aa08d8c6a58e_hlpf-report-2023.pdf. (Accessed January 21, 2024).

Sulitest. (2023b). model of sustainability knowledge [Online Image]. In www.sulitest.org. https://www.sulitest.org/news/how-we-developed-our-assessment-of-sustainability-knowledge-task. (Accessed January 27, 2024).

Szczytko, R., Stevenson, K., Peterson, M. N., Nietfeld, J., & Strnad, R. L. (2018). Development and validation of the environmental literacy instrument for adolescents. Environmental Education Research, 25(2), 193–210. https://doi.org/10.1080/13504622.2018.1487035

Taherdoost, H., Sahibuddin, S., & Jalaliyoon, N. (2014). Exploratory Factor Analysis; Concepts and Theory. Hal.science, 27, 375–382. https://hal.science/hal-02557344

Teksoz, G., Sahin, E., & Tekkaya-Oztekin, C. (2011). Modeling Environmental Literacy of University Students. Journal of Science Education and Technology, 21(1), 157–166. https://doi.org/10.1007/s10956-011-9294-3

The American Heritage dictionary of the English Language. (2022). Knowledge. In www.ahdictionary.com. Retrieved February 11, 2024, from https://www.ahdictionary.com/word/search.html?q=knowledge

Thomas, L. (2020, May 29). Confounding Variables | Definition, Examples and Controls. Scribbr. https://www.scribbr.com/methodology/confounding-variables/

Trapeznikov, L. (2017). The Strategy of Green University: Russian Experience of Implementation. 2017 Tenth International Conference Management of Large-Scale System Development (MLSD), 1–5. doi: 10.1109/MLSD.2017.8109654

UCLA. (2021). A Practical Introduction to Factor Analysis: Exploratory Factor Analysis. Stats.oarc.ucla.edu. https://stats.oarc.ucla.edu/spss/seminars/introduction-to-factor-analysis/a-practical-introduction-to-factor-analysis/

ULSF. (1990). The Talloires Declaration 10 Point Action Plan. Association of University Leaders for a Sustainable Future. https://ulsf.org/wp-content/uploads/2015/06/TD.pdf

UNESCO. (1990). Final Report. UNESDOC Digital Library. World Conference on Education for All - Meeting Basic Learning Needs, Jomtien, Thailand. https://unesdoc.unesco.org/ark:/48223/pf0000097551

UNESCO. (2006). Framework for the UN DESD international implementation scheme. Unesco.org. https://unesdoc.unesco.org/ark:/48223/pf0000148650/PDF/148650eng.pdf.multi

UNESCO. (2014). Shaping the future we want: UN Decade of Education for Sustainable Development (2005 - 2014) final report. UNESCO. https://unesdoc.unesco.org/ark:/48223/pf0000230171

UNESCO. (2016). UNESCO Global Action Programme on Education for Sustainable Development: information folder. In UNESDOC. UNESCO. https://unesdoc.unesco.org/ark:/48223/pf0000246270

UNESCO. (2017). Education for sustainable development goals: Learning objectives. Unesco.org. https://unesdoc.unesco.org/ark:/48223/pf0000247444

UNESCO. (2020). Education for Sustainable Development: A roadmap. UNESCO. https://doi.org/10.54675/yfre1448. (Accessed January 21, 2024).

UNESCO. (2021). Getting every school climate-ready: how countries are integrating climate change issues in education. Unesco.org. https://unesdoc.unesco.org/ark:/48223/pf0000379591/PDF/379591eng.pdf.multi

UNESCO-UNEP. (1977). Intergovernmental Conference on Environmental Education: Final Report. In www.unesdoc.unesco.org. UNESCO. https://unesdoc.unesco.org/ark:/48223/pf0000032763. (Accessed January 27, 2024).

UN General Assembly, United Nations Conference on the Human Environment, 15 December 1972, A/RES/2994, available at: https://www.refworld.org/docid/3b00f1c840.html (Accessed December 10, 2023)

United Nations. (2015). The millennium development goals report 2015. In United Nations. United Nations. https://www.un.org/millenniumgoals/2015_MDG_Report/pdf/MDG%202015%20rev%20(July%201).pdf

United Nations. (2023a). THE 17 GOALS | Sustainable Development. United Nations. https://sdgs.un.org/goals#history

United Nations. (2023b, April 26). Press Release | UN Chief calls for fundamental shift to put world back on track to achieving the Sustainable Development Goals. United Nations Sustainable Development. (Retrieved January 4, 2024, from https://www.un.org/sustainabledevelopment/blog/2023/04/press-release-un-chief-calls-for-fundamental-shift-to-put-world-back-on-track-to-achieving-the-sustainable-development-goals/).

United Nations. (2023c). The Sustainable Development Goals Report Special edition 2023. United Nations. https://unstats.un.org/sdgs/report/2023/The-Sustainable-Development-Goals-Report-2023.pdf

Universität Hamburg. (2023). Jahresbericht 2022. https://www.uni-hamburg.de/uhh/profil/fakten/jahresberichte/jb-2022.pdf

UNSD. (2023). SDG indicators metadata repository. (Retrieved March 15, 2024, from https://unstats.un.org/sdgs/metadata/)

VanderWeele, T. J. (2019). Principles of confounder selection. European Journal of Epidemiology, 34(3), 211–219. https://doi.org/10.1007/s10654-019-00494-6

Veisi, H., Lacy, M., Mafakheri, S., & Razaghi, F. (2018). Assessing environmental literacy of university students: A case study of Shahid Beheshti University in Iran. Applied Environmental Education & Communication, 18(1), 25–42. https://doi.org/10.1080/1533015x.2018.1431163

Waas, T., Verbruggen, A., & Wright, T. (2010). University research for sustainable development: definition and characteristics explored. Journal of Cleaner Production, 18(7), 629–636. https://doi.org/10.1016/j.jclepro.2009.09.017

Wanamaker, C. (2022, October 18). The Environmental, Economic, and Social Components of Sustainability: Adapted from the U.S. Army Corps of Engineers. Soapboxie. https://soapboxie.com/social-issues/The-Environmental-Economic-and-Social-Components-of-Sustainability

Watkins, M. W. (2018). Exploratory Factor Analysis: A Guide to Best Practice. Journal of Black Psychology, 44(3), 219–246. https://doi.org/10.1177/0095798418771807

Webb, D. J., Mohr, L. A., & Harris, K. E. (2008). A re-examination of socially responsible consumption and its measurement. Journal of Business Research, 61(2), 91–98. https://doi.org/10.1016/j.jbusres.2007.05.007

Wilke, R. (1995). Literacy model development and framework. In R. Wilke (Ed.), Environmental education literacy/needs assessment project: Assessing environmental literacy of students and environmental education needs of teachers: Final Report for 1993–1995 (pp. 5–6). (Report to NCEET/University of Michigan under U.S. EPA Grant NT901935-01-2). Stevens Point, WI: University of Wisconsin.

Wright, T. S. A. (2002). Definitions and frameworks for environmental sustainability in higher education. International Journal of Sustainability in Higher Education, 3(3), 203–220. https://doi.org/10.1108/14676370210434679

Yamane, T., & Kaneko, S. (2021a). Impact of raising awareness of Sustainable Development Goals: A survey experiment eliciting stakeholder preferences for corporate behavior. Journal of Cleaner Production, 285. https://doi.org/10.1016/j.jclepro.2020.125291

Yamane, T., & Kaneko, S. (2021b). Is the Younger Generation a Driving Force toward Achieving the Sustainable Development goals? Survey Experiments. Journal of Cleaner Production, 292(1), 125932. https://doi.org/10.1016/j.jclepro.2021.125932

Zhai, T., & Chang, Y.-C. (2018). Standing of Environmental Public-Interest Litigants in China: Evolution, Obstacles and Solutions. Journal of Environmental Law, 30(3), 369–397. https://doi.org/10.1093/jel/eqy011

Zwickle, A., & Jones, K. (2017). Sustainability Knowledge and Attitudes—Assessing Latent Constructs. In: Leal Filho, W., Marans, R., Callewaert, J. (eds) Handbook of Sustainability and Social Science Research. World Sustainability Series. Springer International Publishing, 1, 435–451. https://doi.org/10.1007/978-3-319-67122-2_25

Zwickle, A., M. Koontz, T., M. Slagle, K., & T. Bruskotter, J. (2014). Assessing sustainability knowledge of a student population. International Journal of Sustainability in Higher Education, 15(4), 375–389. https://doi.org/10.1108/ijshe-01-2013-0008