Evaluation of Open Science for co-creation of Social Innovations: A conceptual framework

Evaluación de la Ciencia Abierta para la co-creación de Innovaciones Sociales: Un marco conceptual

  • Monika Maciuliene Kaunas University of Technology
Keywords: open science; co-creation; stakeholder engagement; science policy; social innovation.


Open Science is a rapidly expanding and diversifying field of social innovation with significant implications for and potential benefits to society, policy and various academic research areas. However, much is still unknown about the co-creation processes in Open Science and an overall conceptual framework which aids such understanding is missing. The article aims to address these limitations and identify the key dimensions of an ecosystem allowing co-creation in Open Science to unfold its social and economic impact. The research presented integrates the literature analysis on co-creation in multi-stakeholder ecosystems and suggest that three important dimensions have to be considered in evaluation of Open Science ecosystems: framework conditions, system conditions and outcomes. The proposed model was applied in qualitative analysis of thirty-three Open Science case studies. Based on the results of evaluation, it can be concluded that Open Science landscape is highly heterogenous, fragmented and not fully coordinated. The fragmentation appeared in all dimensions of evaluation. The outcomes of the research provide a first exploratory step in proposing innovative measures to determine the elements of co-creation practices within Open Science context.



La Ciencia Abierta es un campo de innovación social en rápida expansión y diversificación, con importantes implicaciones y beneficios potenciales para la sociedad, la política y diversas áreas de investigación académica. Sin embargo, todavía se desconoce mucho sobre los procesos de co-creación en la Ciencia Abierta y se carece de un marco conceptual general que ayude a su comprensión. Este artículo pretende abordar estas limitaciones e identificar las dimensiones clave de un ecosistema que permita la co-creación en la Ciencia Abierta para desplegar su impacto social y económico. La investigación presentada integra el análisis de la literatura sobre la co-creación en ecosistemas de múltiples partes interesadas y sugiere tres dimensiones importantes a ser consideradas en la evaluación de los ecosistemas de Ciencia Abierta: las condiciones marco, las condiciones del sistema y los resultados. El modelo propuesto ha sido aplicado en el análisis cualitativo de treinta y tres estudios de caso de Ciencia Abierta. A partir de los resultados de la evaluación, se puede concluir que el panorama de la Ciencia Abierta es muy heterogéneo, fragmentado y no está totalmente coordinado. La fragmentación aparece en todas las dimensiones de la evaluación. Los resultados de la investigación proporcionan un primer paso exploratorio para proponer medidas innovadoras que permitan determinar elementos clave en las prácticas de co-creación en el contexto de la Ciencia Abierta.

Palabras clave: ciencia abierta; innovación social; participación de las partes interesadas; co-creación.


DOI: https://doi.org/10.31637/epsir.22-1.1


Adner, R. (2006). Match your innovation strategy to your innovation ecosystem. Harvard Business Review, 84(4), 98.

Arnkil, R., Järvensivu, A., Koski, P., & Piirainen, T. (2010). Exploring quadruple helix outlining user-oriented innovation models. Työraportteja Working Papers 85(2010).

Cai, Y., Ma, J., & Chen, Q. (2020). Higher education in innovation ecosystems. Sustainability, 12(11), 4376. https://doi.org/10.3390/su12114376

Chandler, J. D., Danatzis, I., Wernicke, C., Akaka, M. A., & Reynolds, D. (2019). How does innovation emerge in a service ecosystem? Journal of Service Research, 22(1), 75-89. https://doi.org/10.1177/1094670518797479

Chesbrough, H.W. (2003). Open Innovation: The New Imperative for Creating and Profiting from Technology. McGraw-Hill.

Clarysse, B., Wright, M., Bruneel, J., & Mahajan, A. (2014). Creating value in ecosystems: Crossing the chasm between knowledge and business ecosystems. Research Policy, 43(7), 1164-1176. https://doi.org/10.1016/j.respol.2014.04.014

Corsaro, D., Cantù, C., & Tunisini, A. (2012). Actors' heterogeneity in innovation networks. Industrial Marketing Management, 41(5), 780-789. https://doi.org/10.1016/j.indmarman.2012.06.005

D’Este, P., & Perkmann, M. (2011). Why do academics engage with industry? The entrepreneurial university and individual motivations. The Journal of Technology Transfer, 36(3), 316-339. https://doi.org/10.1007/s10961-010-9153-z

D’Este, P., Ramos-Vielba, I., Woolley, R., & Amara, N. (2018). How do researchers generate scientific and societal impacts? Toward an analytical and operational framework. Science and Public Policy, 45(6), 752-763. DOI: https://doi.org/10.1093/scipol/scy023

de Vasconcelos Gomes, L. A., Facin, A. L. F., Salerno, M. S., & Ikenami, R. K. (2018). Unpacking the innovation ecosystem construct: Evolution, gaps and trends. Technological Forecasting and Social Change, 136, 30-48. https://doi.org/10.1016/j.techfore.2016.11.009

Dobers, P., & Stier, J. (2018). Quadruple Helix Co-creation in SSH: Experiences, considerations, lessons learned in a pan-European study in 12 countries. Proceedings of the 24th Sustainable Development Research Society Conference, 13-15 June 2018, Messina, Italy.

Domanski, D., Howaldt, J., & Kaletka, C. (2020). A comprehensive concept of social innovation and its implications for the local context–on the growing importance of social innovation ecosystems and infrastructures. European Planning Studies, 28(3), 454-474. https://doi.org/10.1080/09654313.2019.1639397

Eckhardt, J., Kaletka, C., Krüger, D., Maldonado-Mariscal, K., & Schulz, A. C. (2021). Ecosystems of Co-Creation. Frontiers in Sociology, 6, 642289. https://doi.org/10.3389/fsoc.2021.642289

Edler, J., & Yeow, J. (2016). Connecting demand and supply: The role of intermediation in public procurement of innovation. Research Policy, 45(2), 414-426. https://doi.org/10.1016/j.respol.2015.10.010

Etzkowitz, H., & Leydesdorff, L. (2000). The dynamics of innovation: from National Systems and “Mode 2” to a Triple Helix of university–industry–government relations. Research Policy, 29(2), 109-123. https://doi.org/10.1016/S0048-7333(99)00055-4

European Commission. (2021). Perspectives on the future of Open Science. https://op.europa.eu/en/publication-detail/-/publication/74cfe2bc-200c-11ec-bd8e-01aa75ed71a1

European Research Council. (2019). Study on Open Access to publications and research data management and sharing within ERC projects. https://zenodo.org/communities/erc-study-on-oa-and-rdm/?page=1&size=20

Frow, P., McColl-Kennedy, J. R., & Payne, A. (2016). Co-Creation Practices: Their Role in Shaping a Health Care Ecosystem. Industrial Marketing Management, 56, 24-39. https://doi.org/10.1016/j.indmarman.2016.03.007

Gagliardi, A.R., Berta, W., Kothari, A., Boyko, J., & Urquhart, R. (2016). Integrated Knowledge Translation (IKT) in Health Care: A Scoping Review. Implement Science, 11(38). https://doi.org/10.1186/s13012-016-0399-1

Greenhalgh, T., Jackson, C., Shaw, S., & Janamina, T. (2016). Achieving Research Impact Through Co-Creation in Community-Based Health Services: Literature Review and Case Study. Millbank, 94, 392-429. https://doi.org/10.1111/1468-0009.12197

Grönroos, C., & Voima, P. (2013). Critical Service Logic: Making Sense of Value Creation and Co-Creation. Journal of the Academy of Marketing Science, 41(2), 133-150. https://doi.org/10.1007/s11747-012-0308-3

Haxeltine, A., Avelino, F., Pel, B., Dumitru, A., Kemp, R., Longhurst, N., Chilvers, J., Wittmayer, J.M. (2016). A Framework for Transformative Social Innovation. TRANSIT Working Paper (5).

Järvi, K., Almpanopoulou, A., & Ritala, P. (2018). Organization of knowledge ecosystems: Prefigurative and partial forms. Research Policy, 47(8), 1523-1537. https://doi.org/10.1016/j.respol.2018.05.007

Jensen, J.L., & Rodgers, R. (2021). Cumulating the Intellectual Gold of Case Study Research. Public Administration Review, 61(2), 235-246. https://doi.org/10.1111/0033-3352.00025

Kazadi, K., Lievens, A., & Mahr, D. (2016). Stakeholder co-creation during the innovation process: Identifying capabilities for knowledge creation among multiple stakeholders. Journal of Business Research, 69(2), 525-540. https://doi.org/10.1016/j.jbusres.2015.05.009

Ketonen-Oksi, S., & Valkokari, K. (2019). Innovation ecosystems as structures for value co-creation. Technology Innovation Management Review, 9(2).

Kramer, M. R., & Pfitzer, M. W. (2016). The ecosystem of shared value. Harvard Business Review, 94(10), 80-89.

Kumari, R., Kwon, K. S., Lee, B. H., & Choi, K. (2019). Co-creation for social innovation in the ecosystem context: The role of higher educational institutions. Sustainability, 12(1), 307. https://doi.org/10.3390/su12010307

Luoma-aho, V., & Halonen, S. (2010). Intangibles and innovation: the role of communication in the innovation ecosystem. Innovation Journalism, 7(2), 1-20.

Macintosh, R., Beech, N., Bartunek, J. M., Mason, K., Cooke, B., Denyer, D. (2017). Impact and management research: Exploring relationships between temporality, dialogue, reflexivity and praxis. British Journal of Management, 28, 3-13. https://doi.org/10.1111/1467-8551.12207

MacSweeney, N., Bowman, S., & Kelly, C. (2019). More than just characters in a story: Effective and meaningful involvement of young people in mental health research. Journal of Public Mental Health, 18(1), 14-16. https://doi.org/10.1108/JPMH-07-2018-0053

Maiello, A., Viegas, C. V., Frey, M., & Ribeiro, J. L. D. (2013). Public managers as catalysts of knowledge co-production? Environmental Science & Policy, 27, 141-150. https://doi.org/10.1016/j.envsci.2012.12.007

Mascarenhas, C., Ferreira, J. J., & Marques, C. (2018). University–industry cooperation: A systematic literature review and research agenda. Science and Public Policy, 45(5), 708-718. https://doi.org/10.1093/scipol/scy003

Mele, C., Spena, T. R., & Colurcio, M. (2010). Co‐creating value innovation through resource integration. International Journal of Quality and Service Sciences, 2(1), 60-78. https://doi.org/10.1108/17566691011026603

Mercan, B., & Göktas, D. (2011). Components of Innovation Ecosystem: A Cross-Country Study. International Research Journal of Finance and Economics. 76, 102-112.

Mezirow, J. (2000). Learning as transformation: Critical perspectives on a theory in progress. Jossey Bass.

Newig, J., & Rose, M. (2020), Cumulating evidence in environmental governance, policy and planning research: towards a research reform agenda. Journal of Environmental Policy & Planning, 22(5), 667-681. https://doi.org/10.1080/1523908X.2020.1767551

Ngongoni, C. N., Grobbelaar, S. S., & Schutte, C. S. (2021). Making Sense of the Unknown: Using Change Attractors to Explain Innovation Ecosystem Emergence. Systemic Practice and Action Research, 1-26. https://doi.org/10.1007/s11213-021-09564-x

OECD. (2021). Open Science - Enabling Discovery in the Digital Age. Policy note. http://goingdigital.oecd.org/data/notes/No13_ToolkitNote_OpenScience.pdf

Open Science Monitor. (2019). Study on Open Science: Monitoring trends and drivers.

Osborne, S. P., Strokosch, K., & Radnor, Z. (2018). Co-production and the co-creation of value in public services: A perspective from service management. Roundtable Papers on New Directions in Co-production and the Delivery of Public Services. Ed. Flemig S., 639-653. https://doi.org/10.1080/14719037.2015.1111927

Regeer, B. J., & Bunders, J. F. (2009). Knowledge co-creation: Interaction between science and society. A Transdisciplinary Approach to Complex Societal Issues. Advisory Council for Research on Spatial Planning, Nature and the Environment/Consultative Committee of Sector Councils in the Netherlands.

Reypens, C., Lievens, A., & Blazevic, V. (2016). Leveraging value in multi-stakeholder innovation networks: A process framework for value co-creation and capture. Industrial Marketing Management, 56, 40-50. https://doi.org/10.1016/j.indmarman.2016.03.005

Rock, J., McGuire, M., & Rogers, A. (2018). Multidisciplinary perspectives on co-creation. Science Communication, 40(4), 541-552. https://doi.org/10.1177/1075547018781496

Roundy, P.T., Bradshaw, M., & Brockman, B.K. (2018). The emergence of entrepreneurial ecosystems: a complex adaptive systems approach. Journal of Business Research, 86, 1-10. https://doi.org/10.1016/j.jbusres.2018.01.032

Silvertown, J. (2009). A new dawn for citizen science. Trends in Ecology and Evolution, 24, 467-471. https://doi.org/10.1016/j.tree.2009.03.017

Sjöö, K., & Hellström, T. (2019). University–industry collaboration: A literature review and synthesis. Industry and higher education, 33(4), 275-285. https://doi.org/10.1177/0950422219829697

Smart, P., Holmes, S., Lettice, F., Pitts, F. H., Zwiegelaar, J. B., Schwartz, G., & Evans, S. (2019). Open Science and Open Innovation in a socio‐political context: knowledge production for societal impact in an age of post‐truth populism. R&D Management, 49(3), 279-297. https://doi.org/10.1111/radm.12377

Tabarés Gutiérrez R., Arrizabalaga E., Nieminen M., Rilla N., Lehtinen S., & Tomminen J. (2020). Stocktaking Report of Co-Change project. https://storage.googleapis.com/co-change/d1-1-stocktaking-report.pdf

Tchorek, G., Brzozowski, M., Dziewanowska, K., Allen, A., Kozioł, W., Kurtyka, M., & Targowski, F. (2020). Social Capital and Value Co-Creation: The Case of a Polish Car Sharing Company. Sustainability, 12(11), 4713. https://doi.org/10.3390/su12114713

Terstriep, J., Rehfeld, D., & Kleverbeck, M. (2020). Favourable social innovation ecosystem(s)? —An explorative approach. European Planning Studies. 28(5), 881-905. https://doi.org/10.1080/09654313.2019.1708868

Torfing, J., Sørensen, E., & Røiseland, A. (2019). Transforming the public sector into an arena for co-creation: Barriers, drivers, benefits, and ways forward. Administration & Society, 51(5), 795-825. https://doi.org/10.1177/0095399716680057

UNESCO. (2020). Multistakeholder Consultations on Open Science. https://en.unesco.org/science-sustainable-future/open-science/consultation

Valkokari, K., Seppänen, M., Mäntylä, M., & Jylhä-Ollila, S. (2017). Orchestrating Innovation Ecosystems: A Qualitative Analysis of Ecosystem Positioning Strategies. Technology Innovation Management Review, 2017, 7, 12-24.

van der Jagt, A.P.N., Raven, R., Dorst, H., & Runhaa, H. (2020). Nature-based innovation systems. Environmental Innovation and Societal Transitions, 35, 202-216. https://doi.org/10.1016/j.eist.2019.09.005

How to Cite
Maciuliene, M. (2022). Evaluation of Open Science for co-creation of Social Innovations: A conceptual framework. European Public & Social Innovation Review, 7(1), 1-16. Retrieved from https://pub.sinnergiak.org/esir/article/view/167
Research articles