Research Article

Development of performance indicators for Occupational Health and Safety: a constructivist multicriteria approach for PPE

Carmen Elena Martínez Riascos; Sandra Rolim Ensslin; Eugenio Andrés Díaz Merino

Downloads: 0
Views: 27


Paper aims: This study aims to develop indicators, using the Multi-Criteria Decision Aid - Constructivist methodology (MCDA-C), to assess the occupational prevention activities in a psychiatric hospital.

Originality: The application to the health sector of MCDA-C, in a case study during the supply of medicines to patients.

Research method: We use the ProKnow-C. Then, MCDA-C was applied in a case study.

Main findings: Four interest areas were defined, then the critical situations were identified to construct 126 specific indicators and finally the intervention strategies were defined. 26 indicators focused on PPE, 4 lagging and 22 leading. The model enabled the mapping of performance indicator levels. For that, 48 recommendations, and intervention strategies for each situation were defined.

Implications for theory and practice: The use of specific indicators, obtained through a participatory process, allowed the identification of accurate and reliable metrics to measure the actual performance of activities, critical situations, and strategies.


Leading indicators. Lagging indicators. Performance measurement. Occupational health and safety. Multi-Criteria Decision Aid - Constructivist (MCDA-C).


Beam, E. L., Gibbs, S. G., Boulter, K. C., Beckerdite, M. E., & Smith, P. W. (2011). A method for evaluating health care workers’ personal protective equipment technique. American Journal of Infection Control, 39(5), 415-420. PMid:21255874.

Behn, R. D. (2003). Why measure performance? Different purposes require different measures. Public Administration Review, 63(5), 586-606.

Casanova, L., Alfano-Sobsey, E., Rutala, W. A., Weber, D. J., & Sobsey, M. (2008). Virus transfer from personal protective equipment to healthcare employees’ skin and clothing. Emerging Infectious Diseases, 14(8), 1291-1293. PMid:18680659.

Cavalluzzo, K. S., & Ittner, C. D. (2004). Implementing performance measurement innovations: evidence from government. Accounting, Organizations and Society, 29(3-4), 243-267.

Chenhall, R. H., & Langfield-Smith, K. (2007). Multiple perspectives of performance measures. European Management Journal, 25(4), 266-282.

Chia, S. E., Koh, D., Fones, C., Qian, F., Ng, V., Tan, B. H., Wong, K. S., Chew, W. M., Tang, H. K., Ng, W., Muttakin, Z., Emmanuel, S., Fong, N. P., Koh, G., & Lim, M. K. (2005). Appropriate use of personal protective equipment among healthcare workers in public sector hospitals and primary healthcare polyclinics during the SARS outbreak in Singapore. Occupational and Environmental Medicine, 62(7), 473-477.

Chughtai, A. A., Chen, X., & Macintyre, C. R. (2018). Risk of self-contamination during doffing of personal protective equipment. American Journal of Infection Control, 46(12), 1329-1334. PMid:30029796.

Coia, J. E., Ritchie, L., Adisesh, A., Makison Booth, C., Bradley, C., Bunyan, D., Carson, G., Fry, C., Hoffman, P., Jenkins, D., Phin, N., Taylor, B., Nguyen-Van-Tam, J. S., & Zuckerman, M. (2013). Guidance on the use of respiratory and facial protection equipment. The Journal of Hospital Infection, 85(3), 170-182. PMid:24051190.

Dutra, A. (1998). Elaboração de um sistema de avaliação de desempenho dos recursos humanos da Secretaria de Estado da Administração - SEA à luz da metodologia multicritério de apoio à decisão (Dissertação de mestrado). Centro Tecnológico, Universidade Federal de Santa Catarina, Florianópolis.

Dutra, A., Ensslin, S. R., Ensslin, L., Ripoll-Feliu, V. M., & Fillol, A. G. (2015). The construction of knowledge from the scientific literature about the theme seaport performance evaluation. International Journal of Productivity and Performance Management, 64(2), 243-269.

Elsler, D., Takala, J., & Remes, J. (2017). An international comparison of the cost of work-related accidents and illnesses. Brussels: European Agency for Safety and Health at Work. Retrieved in 2020, October 21, from

Ensslin, L., Dutra, A., & Ensslin, S. R. (2000). MCDA: a constructivist approach to the management of human resources at a governmental agency. International Transactions in Operational Research, 7(1), 79-100.

Ensslin, L., Ensslin, S., Dutra, A., Nunes, N., & Reis, C. (2017). BPM governance: a literature analysis of performance evaluation. Business Process Management Journal, 23(1), 71-86.

Ensslin, L., Giffhorn, E., Ensslin, S., Petri, S., & Vianna, W. (2010). Avaliação do desempenho de empresas terceirizadas com o uso da metodologia multicritério de apoio à decisão-construtivista. Pesquisa Operacional, 30(1), 125-152.

Ensslin, L., Montibeller Neto, G., & Noronha, S. M. (2001). Apoio à decisão: metodologia para estruturação de problemas e avaliação multicritério de alternativas (296 p.). Florianópolis: Insular.

Ensslin, L., Mussi, C. C., Dutra, A., Ensslin, S. R., & Demetrio, S. N. (2020). Management support model for information technology outsourcing. Journal of Global Information Management, 28(3), 123-147.

Galanis, P., Vraka, I., Fragkou, D., Bilali, A., & Kaitelidou, D. (2021). Impact of personal protective equipment use on health care workers’ physical health during the COVID-19 pandemic: a systematic review and meta-analysis. American Journal of Infection Control. PMid:33965463.

Garengo, P., Biazzo, S., & Bititci, U. S. (2005). Performance measurement systems in SMEs: a review for a research agenda. International Journal of Management Reviews, 7(1), 25-47.

Gosch, M. E., Shaffer, R. E., Eagan, A. E., Roberge, R. J., Davey, V. J., & Radonovich, L. J. Jr (2013). B95: a new respirator for health care personnel. American Journal of Infection Control, 41(12), 1224-1230. PMid:23726655.

Green-McKenzie, J., Gershon, R. R. M., & Karkashian, C. (2001). Infection control practices among correctional healthcare workers: effect of management attitudes and availability of protective equipment and engineering controls. Infection Control and Hospital Epidemiology, 22(9), 555-559. PMid:11732784.

Harrod, M., Weston, L. E., Gregory, L., Petersen, L., Mayer, J., Drews, F. A., & Krein, S. L. (2020). A qualitative study of factors affecting personal protective equipment use among health care personnel. American Journal of Infection Control, 48(4), 410-415. PMid:31610895.

Hinkin, J., Gammon, J., & Cutter, J. (2008). Review of personal protection equipment used in practice. British Journal of Community Nursing, 13(1), 14-19. PMid:18399366.

Igarashi, D. C. C., Paladini, E. P., & Ensslin, S. R. (2007). A metodologia multicritério de apoio à decisão construtivista como subsídio para o gerenciamento interno: estudo de caso no PPGC/UFSC. Organizações & Sociedade, 14(42), 133-149.

International Labour Organization – ILO. (2019). Safety and health at the heart of the future of work: building on 100 years of experience. Geneva: ILO. Retrieved in 2020, October 21, from

International Organization for Standardization – ISO. (2018). ISO 45001:2018: occupational health and safety management systems: requirements with guidance for use (47 p.). Geneva: ISO.

Jacobsen, K., Hofman-Bang, P., & Nordby Junior, R. (2005). The IC Rating? model by Intellectual Capital Sweden. Journal of Intellectual Capital, 6(4), 570-587.

Jain, S., Clezy, K., & McLaws, M. L. (2018). Safe removal of gloves from contact precautions: the role of hand hygiene. American Journal of Infection Control, 46(7), 764-767. PMid:29519650.

John, A., Tomas, M. E., Cadnum, J. L., Mana, T. S. C., Jencson, A., Shaikh, A., Zabarsky, T. F., Wilson, B. M., & Donskey, C. J. (2016). Are health care personnel trained in correct use of personal protective equipment? American Journal of Infection Control, 44(7), 840-842. PMid:27181222.

Jones, R. M., Bleasdale, S. C., Maita, D., & Brosseau, L. M. (2020). A systematic risk-based strategy to select personal protective equipment for infectious diseases. American Journal of Infection Control, 48(1), 46-51. PMid:31358421.

Kang, J., Kim, E. J., Choi, J. H., Hong, H. K., Han, S. H., Choi, I. S., Kim, J., Kim, J. Y., Park, E. S., & Choe, P. G. (2021). Minimizing contamination in the use of personal protective equipment: simulation results through tracking contamination and enhanced protocols. American Journal of Infection Control, 49(6), 713-720. PMid:33159995.

Kang, J., O’Donnell, J. M., Colaianne, B., Bircher, N., Ren, D., & Smith, K. J. (2017). Use of personal protective equipment among health care personnel: results of clinical observations and simulations. American Journal of Infection Control, 45(1), 17-23. PMid:28065328.

Kaplan, R. S., & Norton, D. P. (2000). Having trouble with your strategy? Then map it. Harvard Business Review, 78(5), 167-176, 202. PMid:11143152.

LeRoux, K., & Wright, N. S. (2010). Does performance measurement improve strategic decision making? Findings from a national survey of nonprofit social service agencies. Nonprofit and Voluntary Sector Quarterly, 39(4), 571-587.

Lingard, H., Wakefield, R., & Cashin, P. (2011). The development and testing of a hierarchical measure of project OHS performance. Engineering, Construction, and Architectural Management, 18(1), 30-49.

Longaray, A. A., Ensslin, L., Dutra, A., Ensslin, S., Brasil, R., & Munhoz, P. (2019). Using MCDA-C to assess the organizational performance of industries operating at Brazilian maritime port terminals. Operations Research Perspectives, 6, 100109.

Marafon, A. D., Ensslin, L., Lacerda, R. T. de O., & Ensslin, S. R. (2015). The effectiveness of multi-criteria decision aid methodology. European Journal of Innovation Management, 18(1), 86-109.

Matos, L. S., Iesbik Valmorbida, S. M., & Rolim Ensslin, S. (2018). Gestión y evaluación de la monitorización en el sector de auditoría interna de una Universidad Federal Brasileña: una propuesta constructivista. Revista Electrónica Iberoamericana sobre Calidad, Eficacia y Cambio en Educación, 3(16), 67-85.

Neely, A. (2005). The evolution of performance measurement research: developments in the last decade and a research agenda for the next. International Journal of Operations & Production Management, 25(12), 1264-1277.

Niu, S. (2010). Ergonomics and occupational safety and health: an ILO perspective. Applied Ergonomics, 41(6), 744-753. PMid:20347066.

Payne, S. C., Bergman, M. E., Beus, J. M., Rodríguez, J. M., & Henning, J. B. (2009). Safety climate: leading or lagging indicator of safety outcomes? Journal of Loss Prevention in the Process Industries, 22(6), 735-739.

Podgórski, D. (2015). Measuring operational performance of OSH management system: a demonstration of AHP-based selection of leading key performance indicators. Safety Science, 73, 146-166.

Reiman, T., & Pietikäinen, E. (2012). Leading indicators of system safety: monitoring and driving the organizational safety potential. Safety Science, 50(10), 1993-2000.

Sgourou, E., Katsakiori, P., Goutsos, S., & Manatakis, E. (2010). Assessment of selected safety performance evaluation methods in regards to their conceptual, methodological and practical characteristics. Safety Science, 48(8), 1019-1025.

Škrinjar, R., Bosilj-Vuksic, V., & Indiharstemberger, M. (2008). The impact of business process orientation on financial and non-financial performance. Business Process Management Journal, 14(5), 738-754.

Steege, A. L., Boiano, J. M., & Sweeney, M. H. (2014). NIOSH health and safety practices survey of healthcare workers: training and awareness of employer safety procedures. American Journal of Industrial Medicine, 57(6), 640-652. PMid:24549581.

Tapinos, E., Dyson, R. G., & Meadows, M. (2005). The impact of the performance measurement systems in setting the “direction” in the University of Warwick. Production Planning and Control, 16(2), 189-198.

Thomson Corporation. (2013). EndNote X7. Stamford: Thomson Corporation.

Tomas, M. E., Cadnum, J. L., Mana, T. S. C., Jencson, A. L., Koganti, S., Alhmidi, H., Kundrapu, S., Sunkesula, V. C. K., & Donskey, C. J. (2016). Utility of a novel reflective marker visualized by flash photography for assessment of personnel contamination during removal of personal protective equipment. Infection Control and Hospital Epidemiology, 37(6), 711-713. PMid:26976219.

Tomas, M. E., Kundrapu, S., Thota, P., Sunkesula, V. C., Cadnum, J. L., Mana, T. S. C., Jencson, A., O’Donnell, M., Zabarsky, T. F., Hecker, M. T., Ray, A. J., Wilson, B. M., & Donskey, C. J. (2015). Contamination of health care personnel during removal of personal protective equipment. The Journal of Emergency Medicine, 175, 1904-1910. PMid:26457544.

Torp, S., Grogaard, J. B., Moen, B. E., & Bratveit, M. (2005). The impact of social and organizational factors on workers’ use of personal protective equipment: a multilevel approach. Journal of Occupational and Environmental Medicine, 47(8), 829-837. PMid:16093933.

Tuomela, T. S. (2005). The interplay of different levers of control: a case study of introducing a new performance measurement system. Management Accounting Research, 16(3), 293-320.

Valmorbida, S. M., Ensslin, S., Ensslin, L., & Ripoll-Feliu, V. (2016). Rankings universitários mundiais: que dizem os estudos internacionais? REICE. Revista Electrónica Iberoamericana sobre Calidad, Eficacia y Cambio en Educación, 14(2), 1-25.

Williams, C. K., & Carnahan, H. (2013). Development and validation of tools for assessing use of personal protective equipment in health care. American Journal of Infection Control, 41(1), 28-32. PMid:22704736.

Submitted date:

Accepted date:

6155ab47a95395671d486ee2 production Articles
Links & Downloads


Share this page
Page Sections