Relación de la estrategia, estructura y cultura en la sostenibilidad de las Instituciones de Educación Superior (IES)
Relationship of strategy, structure and culture in the sustainability of Higher Education Institutions (IES) un estudio bibliométrico de las implicaciones para la gestión universitaria
Contenido principal del artículo
Resumen
El propósito del presente estudio es proporcionar un análisis de la información relacionada con las publicaciones de investigación científica asociadas a la gestión universitaria, y su relación con la estrategia, cultura y estructura, disponibles en Web of Science y Scopus. El estudio se desarrolló considerando la siguiente pregunta, ¿cómo se relaciona la estrategia, estructura y cultura en la sostenibilidad de las instituciones de educación superior? Con el fin de alcanzar el objetivo implícito en ella, se desarrolló un análisis bibliométrico a través del programa VOSviewer®. Se identificó los conceptos recurrentes que sirvieron de base para estructurar, a través de un análisis de contenido, la fundamentación teórica de las categorías fundantes que generan tensión en la formulación del problema. Posteriormente, se presenta la discusión que plantea la interacción de las categorías incluidas en la investigación. En el análisis realizado se hace alusión a cómo los elementos de gestión estratégica influyen en las dimensiones de la sostenibilidad, ahí se propone un aporte diferencial susceptible de ser aplicado en contexto, según la naturaleza y tipología en las IES, trascendiendo el alcance de la discusión teórica.
Se identificó que la estrategia, la estructura y la cultura son elementos transversales de una categoría emergente en el estudio denominada gobernanza, que está asociada a la gestión estratégica, a la plena autonomía universitaria, a los nuevos instrumentos de responsabilidad pública y al aseguramiento de la calidad. Se encontró que la gobernanza, es catalogada en la literatura reciente, como el factor determinante para la sostenibilidad de las IES.
Detalles del artículo
Referencias (VER)
Abdulaziz, M. A. (2022). Do subcultures play a role in facilitating academic quality? A case study of a Saudi higher education institution. Humanit. Soc. Sci. Commun., 9, 227. https://doi.org/10.1057/s41599-022-01250-0
Adams, R., Martin, S. & Boom, K. (2018). University culture and sustainability: Designing and implementing an enabling framework. Journal of Cleaner Production, 171, 434–445. https://doi.org/10.1016/j.jclepro.2017.10.032
Adenle, Y. A., Chan, E. H., Sun, Y. & Chau, C. K. (2021). Assessing the relative importance of sustainability indicators for smart campuses: A case of higher education institutions in Nigeria. Environmental and Sustainability Indicators, 9, 100092. https://doi.org/10.1016/j.indic.2020.100092
Adipat, S. (2022). Sustainable development goal 4: an education goal to achieve equitable quality education. Academic Journal of Interdisciplinary Studies 11(6),174. https://doi.org/10.36941/ajis-2022-0159
Al-nuaimi, S. R. & Al-Ghamdi, S. G. (2022). Assessment of knowledge, attitude and practice towards sustainability aspects among higher education students in Qatar. Sustainability, 14(20), 13149. https://doi.org/10.3390/su142013149
Aleixo, A. M., Leal, S. & Azeiteiro, U. M. (2018). Conceptualization of sustainable higher education institutions, roles, barriers, and challenges for sustainability: an exploratory study in Portugal. Journal of Cleaner Production, 172, 1664–1673. https://doi.org/10.1016/j.jclepro.2016.11.010
Arbeláez, H., Serna, H. y Díaz, A. (2015). Modelos gerenciales. Un marco conceptual. Fondo Editorial Cátedra María Cano. https://www.fumc.edu.co/documentos/elibros/Modelos%20Gerenciales-un%20marco%20conceptual%201era%20Ed%202014.pdf
Barney, J. (1986). Organizational culture can be a source of sustained competitive advantage. The Academy of Management Review, 11(3), 656-665. https://doi.org/10.2307/258317
Bauer, M., Niedlich, S., Rieckmann, M., Bormann, I. & Jaeger, L. (2020). Interdependencies of culture and functions of sustainability governance at higher education institutions. Sustainability, 12(7), 2780. https://doi.org/10.3390/su12072780
Biondi, L. & Russo, S. (2022). Integrating strategic planning and performance management in universities: a multiple case-study analysis. Journal of Management and Governance, 26, 417–448. https://doi.org/10.1007/s10997-022-09628-7
Blasco, N., Brusca, I. & Labrador, M. (2019). Assessing sustainability and its performance implications: an empirical analysis in spanish public universities. Sustainability, 11(19), 5302. https://doi.org/10.3390/su11195302
Braun, V. & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77-101. https://doi.org/10.1191/1478088706qp063oa
Brundtland, G. (1987). Report of the world commission on environment and development: our common future. Oxford University Press.
Burns, T. & Stalker, G. (1969). The management of innovation. Social Science Paperbacks. The Economic Journal, 79(314), 403–405. https://doi.org/10.2307/2230196
CESU. (2020). Acuerdo 2 de julio 1 de 2020, página 63, por el cual se actualiza el modelo de acreditación en alta calidad. Ministerio de Educación Nacional. https://www.cna.gov.co/1741/articles-186370_Acuerdo_02_2020_NUev_Modelo.pdf
Chandler, A. D. (2003). Strategy and structure: Chapters in the history of the American industrial enterprise. Beard Books.
Chanlat, A. & Dufour, M. (1985). La rupture entre l’entreprise et les hommes. Éditions Québec-Amérique.
Csillag, S., Király, G., Rakovics, M. & Géring, Z. (2022). Agents for sustainable futures? The (unfulfilled) promise of sustainability at leading business schools. Futures, 144. https://doi.org/10.1016/j.futures.2022.103044
Dalft, R. (1998). Teoría y diseño organizacional (11.a ed.). Soluciones Empresariales.
De Aguirre, L. S. & Retolaza, J. L. (2012). Participation of stakeholders in corporate governance: foundation ontological and methodological proposal. Universitas Psychologica, 11(2), 619–628. https://doi.org/10.11144/javeriana.upsy11-2.psgc
Deal, T. & Kennedy, A. (2000). Corporate cultures. The rites and rituals of corporate life. Perseus Books Publishing.
Denison, D. & Mishra, A. (1995). Toward a theory of organizational culture and effectiveness. Organization Science, 6(2), 204-223. https://pubsonline.informs.org/doi/10.1287/orsc.6.2.204
Dmochowski, J. E., Garofalo, D., Fisher, S., Greene, A. & Gambogi, D. (2016). Integrating sustainability across the university curriculum. International Journal of Sustainability in Higher Education, 17(5), 652–670. https://doi.org/10.1108/IJSHE-10-2014-0154
Elkington, J. (2019). 25 years ago I coined the phrase “triple bottom line”. Here’s why it’s time to rethink it. Harvard Business Review. https://hbr.org/2018/06/25-years-ago-i-coined-the-phrase-triple-bottom-line-heres-why-im-giving-up-on-it
Ertosun, O.G., Adiguzel, Z. (2018). Leadership, Personal Values and Organizational Culture. In: Dincer, H., Hacioglu, Ü., Yüksel, S. (eds) Strategic Design and Innovative Thinking in Business Operations. Contributions to Management Science. Springer, Cham. https://doi.org/10.1007/978-3-319-77622-4_3
Escobar, M., Valencia, P. & Vera, L. D. (2018). A new corporate entrepreneurship knowledge schema as a research field. Academy of Entrepreneurship Journal, 24(4).
Findler, F. (2021). Toward a sustainability assessment framework of research impacts: contributions of a business school. Sustainable Development, 29(6), 1190–1203. https://doi.org/10.1002/sd.2218
Findler, F., Schönherr, N., Lozano, R. & Stacherl, B. (2018). Assessing the impacts of higher education institutions on sustainable development-an analysis of tools and indicators. Sustainability, 11(1), 59. https://doi.org/10.3390/su11010059
Findikli, B. (2021). Between autonomy and central control : a tale of two university reforms in Turkey during the single ‑ party era. Higher Education Policy, 35, 855-872. https://doi.org/10.1057/s41307-021-00236-y
Fong, C., Flores, K. E. y Cardoza, L. M. (2017). La teoría de recursos y capacidades: un análisis bibliométrico. Nova Scientia, 9(19), 411–440. http://www.redalyc.org/articulo.oa?id=203353519023
Garzón, C. y Rodríguez, P. (2019). La gobernanza y su incidencia en los procesos de calidad en las instituciones de educación superior. Revista Boletín Redipe, 8(10), 111–124. https://doi.org/10.36260/rbr.v8i10.838
Godet, M. (2007). Manuel de prospective stratégique. Une indiscipline intellectuelle (3.a ed). Dunod.
González Alcántara, O.J., Fontaneda González, I. & Camino López, M. Á. (2022). University Social Responsibility: the case of the Spanish Universities: Tools for their communication. VISUAL REVIEW: International Visual Culture Review, 10(4), 1–25. https://doi.org/10.37467/revvisual.v9.3614
Górska, A., Pikos, A., Dobija, D. & Grossi, G. (2022). Autonomy without accountability in resource allocation reforms: blending old and new logic in universities. Central European Management Journal, 30(2), 43–82. https://doi.org/10.7206/cemj.2658-0845.75
Griffin, M., Barona, J. & Gutiérrez, C. F. (2022). Strategies to increase sustainability awareness in higher education: experiences from Abu Dhabi women’s college. International Journal of Sustainable Development and Planning, 17(6), 1831–1838. https://www.iieta.org/journals/ijsdp/paper/10.18280/ijsdp.170617
Gulcimen, S., Qadri, S., Donmez, R. O. & Uzal, N. (2022). A holistic sustainability assessment of a university campus using a life cycle approach. International Journal of Environmental Science and Technology, 20, 3309–3322. https://doi.org/10.1007/s13762-022-04214-8
Heaton, S. & Teece, D. (2022). Dynamic capabilities and governance: an empirical investigation of financial performance of the higher education sector. Strategic Management Journal, 44(2), 520-548. https://doi.org/10.1002/smj.3444
Hernández-Díaz, P. M., Polanco, J. A. & Castaño, S. M. (2020a). Do sustainability practices influence university quality? A Colombian case study. International Journal of Sustainability in Higher Education, 21(7), 1525–1543. https://doi.org/10.1108/IJSHE-03-2020-0087
Hernández-Díaz, P. M., Polanco, J. A. & Escobar-Sierra, M. (2020b). Building a measurement system of higher education performance: evidence from a Latin-American country. International Journal of Quality and Reliability Management, 38(6), 1278–1300. https://doi.org/10.1108/IJQRM-04-2020-0133
Hernández-Díaz, P. M., Polanco, J. A., Escobar-Sierra, M. & Leal, W. (2021). Holistic integration of sustainability at universities: evidences from Colombia. Journal of Cleaner Production, 305, 127145. https://doi.org/10.1016/j.jclepro.2021.127145
Hilman, H. & Siam, M. (2014). The influence of organizational structure and organization culture on the organizational performance of higher educational institutions: the moderating role of strategy communication. Canadian Center of Science and Education, 10(13), 142–154. https://doi.org/10.5539/ass.v10n13p142
Huang, W., Yao, P. & Li, F. (2021). Student governments in Chinese higher education: reflection on college students’ and student cadres’ political trust. Higher Education, 82, 387-409. https://doi.org/10.1007/s10734-021-00721-8
Juiz, C., Duhamel, F., Guti, I. & Luna-Reyes, L. F. (2022). IT managers’ framing of IT governance roles and responsibilities in Ibero-American Higher Education Institutions. Informatics, 9(3), 68. https://doi.org/10.3390/informatics9030068
Karjanto, N. (2022). Sustainable learning, cognitive gains, and improved attitudes in college algebra flipped classrooms. Sustainability, 14(19), 12500. https://doi.org/10.3390/su141912500
Kasemsap, K., Styron, R. A. & Styron, J. L. (2017). Exploring the role of organizational culture in modern organizations. Igi Global. 10.4018/978-1-5225-1913-3.ch073
Khairy, T., Ibrahim, T. & Al-matari, E. M. (2022). The effect of governance rules application controls and the accrual basis application controls on quality of financial reporting: applying to jouf university. Sustainability, 14(5), 2831. https://doi.org/10.3390/su14052831
Kich, J. & Pereira, M. F. (2011). A influência da liderança, cultura, estrutura e comunicação organizacional no processo de implantação do planejamento estratégico. Cadernos EBAPE.BR, 9(4), 1045–1065. https://doi.org/10.1590/S1679-39512011000400007
Labarca, N. (2008). Evolución del pensamiento estratégico en la formación de la estrategia empresarial. Opción, 24(55), 47–68. http://ve.scielo.org/scielo.php?script=sci_arttext&pid=S1012-15872008000100004
Leal, W., Salvia, A., Frankenberger, F., Akib, N., Sen, S., Sivapalan, S., Novo-Corti, I., Venkatesan, M. & Emblen-Perry, K. (2021). Governance and sustainable development at higher education institutions. Environment, Development and Sustainability, 23, 6002–6020. https://doi.org/10.1007/s10668-020-00859-y
Li, G., Xi, Y. & Zhu, Z. (2022). The way to sustainability: education for sustainable development in China. Asia Pacific Education Review, 23, 611–624. https://doi.org/10.1007/s12564-022-09782-5
Li, J. & Xue, E. (2022). Exploring high-quality institutional internationalization for higher education sustainability in China: evidence from stakeholders. Sustainability, 14(13), 7572. https://doi.org/10.3390/su14137572
Lozano, R. (2018). Proposing a definition and a framework of organisational sustainability: a review of efforts and a survey of approaches to change. Sustainability, 10(4), 1157. https://doi.org/10.3390/su10041157
Luo, L., Yang, Y., Zheng, J. & Xie, J. (2022). Measuring project governance of mega infrastructure in china: a scale development study. Sustainability, 14(2), 593. https://doi.org/10.3390su14020593
Lv, M., Zhang, H., Georgescu, P., Li, T. & Zhang, B. (2022). Improving education for innovation and entrepreneurship in chinese technical universities: a quest for building a sustainable framework. Sustainability, 14(2), 595. https://doi.org/10.3390/su14020595
Maldonado, B., Buenaño, J. & Benavides, K. (2019). Approximation to a model of governance in public Universities of the province of Pichincha of Ecuador. Visión de Futuro, 23(2), 122–137. https://doi.org/10.36995/j.visiondefuturo.2019.23.02.006.en
Marchisott, G., Rodrigues Filho, S., França, S., Toledo, R., Castro, H., Alves, C. & Putnik, S. (2021). Hybrid governance system value perception model. International Journal for Quality Research, 16(1), 261–278. https://www.proquest.com/docview/2622990533?sourcetype=Scholarly%20Journals
Marín, D. (2012). Estructura organizacional y sus parámetros de diseño: análisis descriptivo en pymes industriales de Bogotá. Estudios Gerenciales, 28(123), 43–64. http://www.scielo.org.co/pdf/eg/v28n123/v28n123a04.pdf
Marín, D. y Lozada, L. (2015). Estructura organizacional y relaciones interorganizacionales: análisis en instituciones prestadoras de servicios de salud públicas de Colombia. Estudios Gerenciales, 31(134), 88–99. https://doi.org/10.1016/j.estger.2014.08.004
Mejía, F. (2022). Incidencia de la gobernanza en la sostenibilidad de una IES acreditada pública: un estudio de caso en la Universidad del Tolima, Ibagué, Colombia.
Mekonnen, G. T., Kilpatrick, S., Kenny, J., Kilpatrick, S. & Kenny, J. (2022). Constrained autonomy: academics and institutional leaders empowerment in Ethiopia in the context of the Bologna Process. Journal of Further and Higher Education, 46(2), 143–158. https://doi.org/10.1080/0309877X.2021.1895091
Mignot-Gérard, S., Sponem, S., Chatelain-Ponroy, S., & Musselin, C. (2022). Kaleidoscopic collegiality and the use of performance research metrics. The case of French universities. Higher Education, 85, 887–918. https://doi.org/10.1007/s10734-022-00871-3
Mintzberg, H. (1991). The effective organization: forces and forms. Sloan Management Review, 32(2), 54–67.
Mintzberg, H., Quinn, J. & Voyer, J. (1997). El proceso estratégico, conceptos, contextos y casos. Prentice Hall.
Mohelska, H. & Pitra, Z. (2002). Manaћerskй metody. Professional Publishing.
Moher, D., Liberati, A., Tetzlaff, J. & Altman, D. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Journal of Clinical Epidemiology, 62(10), 1006–1012. https://doi.org/10.1016/j.jclinepi.2009.06.005
Moreno, L., Peris, F. & González, T. (2001). La gestión de la calidad y diseño de organizaciones: teoría y estudio de casos. Pearson Educación.
Morín, E. (1996). Introducción al pensamiento complejo. Gedisa.
Morín, E. (1999). Los siete saberes necesarios para la educación del futuro. UNESCO.
Muhammad, T., Muhammad, N. & Khan, S. (2022). Assessing governance and regulatory reforms: a public policy analysis of universities in KPK. Journal of Managerial Sciences, 16(2), 16–29. https://journals.qurtuba.edu.pk/ojs/index.php/jms/article/view/508
Nadler, D. & Tushman, M. (1997). Competing by design: the power of organizational architecture. Oxford University Press.
Neis, D., Pereira, M. & Maccari, E. (2017). Strategic planning process and organizational structure: impacts, confluence and similarities. BBR. Brazilian Business Review, 14(5), 479–492. https://www.scielo.br/scielo.php?script=sci_arttext&pid=S1808-23862017000500479
Niedlich, S., Rieckmann, M., Kummer, B., Bormann, I. & Bauer, M. (2019b). Cultures of sustainability governance in higher education institutions: a multi-case study of dimensions and implications. Higher Education Quarterly, 73(3), 373-390 https://onlinelibrary.wiley.com/doi/epdf/10.1111/hequ.12237
Obrecht, M., Feodorova, Z. & Rosi, M. (2022). Assessment of environmental sustainability integration into higher education for future experts and leaders. Journal of Environmental Management, 316, 115223. https://doi.org/10.1016/j.jenvman.2022.115223
Oliveira, N. P. & Resende, P. C. (2020). Proposta de instrumento para avaliação da governança organizacional em uma instituição do setor público. Revista do Serviço Público, 71(2), 397–426. https://doi.org/10.21874/rsp.v71i2.3523
Özdemİr, A., Özalp, U. & Akkaya, R. (2022). Prioritizing MoNE 2019-2023 strategic goals and objectives with analytical hierarchy process and analysis of relationship between affecting-affected strategic goals with DEMATEL method. Hacettepe Üniversitesi Eğitim Fakültesi Dergisi, 37(3), 858–877. https://doi.org/10.16986/HUJE.2021067518
Paramitha, M., Agustia, D. & Soewarno, N. (2017). Good governance, organizational culture, and performance of higher education in indonesia: a conceptual framework. International Journal of Scientific and Research Publications, 7(12), 528–535. https://www.ijsrp.org/research-paper-1217/ijsrp-p7270.pdf
Patton, J. & White, D. (2002). Closing the strategic vision/implementation Gap. Project Management Institute Annual Seminars & Symposium. Project Management Institute. https://www.pmi.org/learning/library/closing-strategic-vision-implementation-gap-109
Pedraja-Rejas, L. y Rodríguez-Ponce, E. (2021). Gobernanza y calidad en la educación superior : una descripción bibliométrica. Fronteiras, 10(3), 252-265. https://doi.org/10.21664/2238-8869.2021v10i3
Radcliffe, A. & Brown, A. (1962). Structure and function in primitive society. The Free Press.
Rajasekharanm, P., Sankaran, K., Ramnarayan, K. & Prabhu, N. (2021). Research in higher education governance: past performance and an agenda for the future. Educational Review, 75(6), 1255–1278. https://doi.org/10.1080/00131911.2021.1984214
Ramírez, Y. & Tejada, Á. (2018). Corporate governance of universities: improving transparency and accountability. International Journal of Disclosure and Governance, 15, 29–39. https://doi.org/10.1057/s41310-018-0034-2
Ramzy, O., Bedawy, R., Anwar, M. & Eldahan, O. H. (2019). Sustainable development & good governance. European Journal of Sustainable Development, 8(2), 125–138. https://doi.org/10.14207/ejsd.2019.v8n2p125
Rasli, A., Tee, M., Lai, Y. L. & Tiu, Z. C. (2022). Post-COVID-19 strategies for higher education institutions in dealing with unknown and uncertainties. Frontiers in Education, 7. https://doi.org/10.3389/feduc.2022.992063
Rath, K. & Schmitt, C. (2017). Sustainability at universities: degrees of institutionalization for sustainability at german higher education institutions. A categorization pattern. Springer International Publishing.
Rymarzak, M., Heijer, A., Curvelo Magdaniel, F. & Arkesteijn, M. (2020). Identifying the influence of university governance on campus management: lessons from the Netherlands and Poland. Studies in Higher Education, 45(7), 1298–1311. https://doi.org/10.1080/03075079.2019.1616167
Salovaara, J. J. (2022). Sustainability alumni at work. Interviews on educated sustainability professionalism. Sustainability, 14(22), 14774. https://doi.org/10.3390/su142214774
Sander, B. (2006). Nuevas tendencias en la gestión educativa: democracia y calidad. https://repository.unad.edu.co/bitstream/handle/10596/8327/406007_NUEVAS_TENDENCIAS_EN_LA_GESTIN_EDUCATIVA.pdf?sequence=3
Schein, E. H. (1985). Organizational culture and leadership (3.a ed.). Jossey-Bass.
Shin, J. C., Li, X., Nam, I. & Byun, B. (2022). Institutional autonomy and capacity of higher education governance in South Asia: a comparative perspective. Higher Education Policy, 35, 414–438. https://doi.org/10.1057/s41307-020-00220-y
Suharto, R. B., Sutrisno, T. W., Setyadi, D. & Mintarti, S. (2022). Can performance be achieved through the role of normative commitment as mediation and innovation as moderator: driven by good governance, driving human resources intrinsic and motivation?, Quality Access to Success, 23(189), 348–358. https://doi.org/10.47750/QAS/23.189.40
Swartz, P., Da Veiga, A. D. & Martins, N. (2021). Validating an information privacy governance questionnaire to measure the perception of employees. Information and Computer Security, 29(5), 761–786. https://doi.org/10.1108/ICS-08-2020-0135
Tahiraj, I. & Krek, J. (2022). Organisational culture in public university: a case study in Kosovo. Center for Educational Policies Studies Journal, 12(3), 127–147. https://doi.org/10.26529/cepsj.1198
Tandilashvili, N. & Tandilashvili, A. (2022). Academics perception of identity (re)construction: a value conflict created by performance orientation. Journal of Management & Governance, 26(2), 389-416. https://ideas.repec.org/a/kap/jmgtgv/v26y2022i2d10.1007_s10997-022-09627-8.html
Tercanli, H. & Jongbloed, B. (2022). A systematic review of the literature on living labs in higher education institutions: potentials and constraints. Sustainability, 14(19), 12234. https://doi.org/10.3390/su141912234
Thi, P., Hai, T., Thi, L. & Anh, K. (2022). Studies in Higher Education Academic staff ’ s participation in university governance - a move towards autonomy and its practical problems. Studies in Higher Education, 47(8), 1613–1626. https://doi.org/10.1080/03075079.2021.1946031
Turner, J. H. (1986). The theory of structuration the constitution of society: outline of the theory of structuration. Anthony Giddens. American Journal of Sociology, 91(4), 969–977. https://doi.org/10.1086/228358
Vargas, J. G. (2008). Teoría institucional y neoinstitucional en la administración internacional de las organizaciones. Revista Científica “Visión de Futuro”, 10(2), 1-22. https://www.redalyc.org/pdf/3579/357935471005.pdf
Wang, Y., Liu, Q. & Chen, R. (2022). Comparative study on the internal governance models of Chinese and European universities. Asia Europe Journal, 20, 115–135. https://doi.org/10.1007/s10308-021-00636-0
Yin, J. & Li, C. (2022). Data governance and green technological innovation performance: a curvilinear relationship. Journal of Cleaner Production, 379(part 1), 134441. https://doi.org/10.1016/j.jclepro.2022.134441
Yousef, A., Zamil, A. & Fathi, A. (2020). The concept of governance in universities: reality and ambition. International Journal of Innovation, Creativity and Change, 13(1), 951-969. https://www.ijicc.net/images/vol_13/13191_Areiqat_2020_E_R.pdf
Zapata, A. y Rodríquez, A. (2008). Cultura organizacional. Universidad del Valle.
Zapata, G., Mirabal, A. y Hernández, A. (2009). Modelo teórico conceptual de la estructura organizativa: un análisis contingente. Ciencia y Sociedad, 34(4). 10.22206/cys.2009.v34i4.pp618-640