Research Article

Concordance measurement applying the Delphi method: proposal and evaluation of a set determinants factor of the Triple Helix existence

Antônio Honorato de Oliveira; Fernando Augusto Silva Marins; Maurício César Delamaro

Downloads: 0
Views: 40


Paper aims: This article presents the development and results of research carried out to know the modus agendi of a Regional Triple Helix and measure the intensity of the presence of a set of factors proposed as determinants of its existence and consolidation.

Originality: This is an unprecedented contribution to research in TH, as it investigates how much an established regional reality matches the pattern of a modus agendi and a set of determining factors of its existence and consolidation.

Research method: The inductive basic research method was adopted, with qualitative and quantitative approach, exploratory and descriptive objective and field research, applying the e-Delphi method.

Main findings: A high degree of misalignment of perceptions was identified among respondents and the existence of a Triple Helix that is still consolidating.

Implications for theory and practice: The relevance of this article is corroborated by the unprecedented application of the calculation of three statistical indicators (CVI-h; CV; IR) in the e-Delphi method. Another important contribution of this research lies in the fact that it investigates the level of alignment of the modus agendi of a TH, with a set of determinant factors that indicate the existence and consolidation of this development.


Triple helix, Delphi method, Concordance Validation Index, Concordance measurement, Enabling solutions, Innovation


Alexandre, N. M. C., & Coluci, M. Z. O. (2011). Validade de conteúdo nos processos de construção e adaptação de instrumentos de medidas. Ciência & Saúde Coletiva, 16, 3061-3068.

Ameyaw, E. E., Hu, Y., Shan, M., Chan, A. P. C., & Le, Y. (2016). Application of Delphi method in construction engineering and management research: a quantitative perspective. Journal of Civil Engineering and Management, 22(8), 991-1000.

Beatty, W. (2018). Four facts about all Statistics. In W. Beatty (Ed.), Decision support using nonparametric statistics. (Springer Briefs in Statistics). Cham: Springer.

Beck, U. (2010). Individualization, institutionalization and standardization of living conditions and biographical models. In U. Beck, Risk society: towards another modernity. São Paulo: Editora 34. Translated by Sebastião Nascimento.

Chung, C. J., & Park, H. W. (2014). Mapping Triple Helix innovation in developing and transitional economies: webometrics, scientometrics, and informetrics. Scientometrics, 99(1), 1-4.

Cortez, R. M., & Johnston, W. J. (2017). The future of B2B marketing theory: A historical and prospective analysis. Industrial Marketing Management, 66, 90-102.

Creswell, J. W. (2014). A concise introduction to mixed methods research. Los Angeles: Sage Publications.

Dalmoro, M., & Vieira, K. M. 2014. Dilemmas in the construction of Likert-type scales: do the number of items and the disposition influence the results? Revista Gestão Organizacional, 6(3), 161-174. Available in:,5.

Davis, L. L. (1992). Instrument review: Getting the most from your panel of experts. Applied Nursing Research, 5(4), 194-197.

De Carli, P. C., Delamaro, M. C., & Salomon, V. A. P. (2010). Identification and prioritization of critical success factors in a digital factory implementation. Production, 20(4), 549-564.

Eberhart, M. E., & Pascuci, L. 2014. The decision-making process and its implications for university, business and government cooperation: a case study. Revista GUAL, 7(2), 221-242. Available at:

Etzkowitz, H. (2013). Triple Helix: University-industry-government: innovation in motion. Porto Alegre: EDIPUCRS, 2013.

Etzkowitz, H. (2017). Innovation Lodestar: The entrepreneurial university in a stellar knowledge firmament. Technological Forecasting and Social Change, 123, 122-129. Available in:

Etzkowitz, H., & Zhou, C. (2017). Triple Helix: Innovation and entrepreneurship university-industry-government. Advanced Studies, 31(90), 23-48. Available in:

Giannarou, L. & Zervas, E. (2014). Using Delphi technique to build consensus in practice. International Journal of Business Science & Applied Management, 9(2), 65-82.

Grisham, T. (2009). The Delphi technique: a method for testing complex and multifaceted topics. International Journal of Managing Projects in Business, 2(1), 112-130. Available in:

Hasson, F., & Keeney, S. (2011). Enhancing rigour in the Delphi technique research. Technological Forecasting and Social Change, 78(9), 1695-1704. Available in:

Holland, S., & Oliveira, T. C. (2014). The Rise, decline, and regeneration of industrial districts: Enhanced HRM, SMEs, and location. In Machado, C. & Melo, P. Effective human resources management in small and medium enterprises: Global perspectives (pp. 238-279). Hershey, PA: IGI Global. Available in:

Kapetaniou, C., & Lee, S. H. (2017). A framework for assessing the performance of universities: the case of Cyprus. Technological Forecasting and Social Change, 123(1), 169-180.

Kim, M., Jang, Y. C., & Lee, S. (2013). Application of Delphi-AHP methods to select the priorities of WEEE for recycling in a waste management decision-making tool. Journal of Environmental Management, 128, 941-948. Available in:

Kobza, N., & Mutlucan, C. (2016). Entrepreneurship leading a change in Europe: a perspective of young professionals. IFAC-PapersOnLine, 49(29), 289-293. Available in:

Landeta, J., Barrutia, J., & Lertxundi, A. (2011). Hybrid Delphi: A methodology to facilitate contribution from experts in professional contexts. Technological Forecasting and Social Change, 78(9), 1629-1641. Available in:

Lawthon, S. H., & Leydesdorff, L. (2014). The Triple Helix in the context of global change: dynamics and challenges. Prometheus, 32(4), 321-336. Available in:

Lee, Y. H., & Kim, Y. (2016). Analyzing interaction in R&D networks using the Triple Helix method: Evidence from industrial R&D programs in Korean government. Technological Forecasting and Social Change, 110, 93-105. Available in:

Leydesdorff, L. (2013). Triple Helix of university-industry-government relations. In E.G. Carayaniss (Ed.), Encyclopedia of creativity, invention, innovation and entrepreneurship (pp. 1844-1851). New York, NY: Springer.

Linstone, H. A., & Turoff, M. (2011). Delphi: A brief look backward and forward. Technological Forecasting and Social Change, 78(9), 1712-1719. Available in:

Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35(6), 382-385. PMid:3640358.

Manzini, E. (2014). Making things happen: Social innovation and design. Design Issues, 30(1), 57-66.

Martuza, V. R. (1977). Applying norm-referenced and criterion-referenced measurement in education. Boston: Allyn & Bacon.

Miguel, P. A. C. (2012). Research methodology in production engineering and operations management (2nd ed.). Rio de Janeiro: Elsevier Editora.

Nogueira, V. D. C., & Fuscaldi, K. (2018). Painel de especialistas e Delphi: métodos complementares na elaboração de estudos de futuro. Brasília, DF: Embrapa. Available in:

Oliveira, A. H. (2012). Inserções no Modelo da Tríplice hélice: um estudo de caso na incubadora do Inatel. In XII Encontro Latino Americano de Pós-Graduação. São José dos Campos, São Paulo: Universidade do Vale do Paraíba.

Oliveira, A. H., Marins, F. A. S., Delamaro, M. C. (2018). Business engineering incubators: a cooperation case for cluster’s development. Production, 28, 1-16. Available in:

Okoli, C., & Pawlowski, S. D. 2004. The delphi method as a research tool: an example, design considerations and applications. Information & Management, 42(1), 15-29. Available in:

Pellin, D. R., & Engelmann, W. A. (2018). Economic analysis of the law of individual microentrepreneurs beyond the law: politics. Economic Analysis of Law Review, 9(2), 177-193.

Polit, D. F., & Beck, C. T. (2006). The content validity index: are you sure you know what’s being reported? Critique and recommendations. Research in Nursing & Health, 29(5), 489-497. Available in:

Rúbio, D. M., Berg-Weger, M., Tebb, S. S., Lee, E. S., & Rauch, S. (2003). Objectifying content validity: Conducting a content validity study in social work. Social Work Research, 27(2), 94-104.

Strasser, A. (2017). Delphi method variants in information systems research: Taxonomy development and application. The Electronic Journal of Business Research Methods, 15(2), 120-133. Available in:

Sum, N. L., & Jessop, B. (2013). Competitiveness, the knowledge-based economy and higher education. Journal of the Knowledge Economy, 4(1), 24-44.

Verlinde, S., & Macharis, C. (2016). Innovation in urban freight transport: The triple Helix model. Transportation Research Procedia, 14, 1250-1259. Available in:

Vlaisavljevic, V., Medina, C. C., & Van Looy, B. (2020). The role of policies and the contribution of cluster agency in the development of biotech open innovation ecosystem. Technological Forecasting and Social Change, 155, 119987.

Woodside, A. G. (2010). Case study research: Theory, methods and practice. United Kingdom: Emerald Group Publishing.

Worrell, J. L., Di Gangi, P. M., & Bush, A. A. (2013). Exploring the use of the Delphi method in accounting information systems research. International Journal of Accounting Information Systems, 14(3), 193-208.

Wynd, C. A., Schmidt, B., & Schaefer, M. A. (2003). Two quantitative approaches for estimating content validity. Western Journal of Nursing Research, 25(5), 508-518. PMid:12955968.

Zhai, B., & Ng, M. K. (2013). Urban regeneration and social capital in China: A case study of the Drum Tower Muslim District in Xi’an. Cities, 35, 14-25.

Yin, R. K. (2017). Case study research and applications: Design and methods. Thousand Oaks, CA: Sage Publications.

Submitted date:

Accepted date:

611ebd35a9539516ae3e7924 production Articles
Links & Downloads


Share this page
Page Sections