CARACTERIZAÇÃO DOS INDICADORES DA AVALIAÇÃO DO DESEMPENHO DOS SISTEMAS DE GESTÃO
CHARACTERIZATION OF INDICATORS FOR ASSESSING THE PERFORMANCE OF MANAGEMENT SYSTEMS
Carmen Elena Martinez Riascos, Sandra Rolim Ensslin, Eugenio Andrés Díaz Merino
Resumo
A ergonomia está relacionada à proteção da saúde dos trabalhadores involucrando os domínios físico, cognitivo e organizacional atingindo uma abordagem sistêmica em todos os aspectos da atividade humana. No mesmo sentido das atividades do Sistema de Gestão de Segurança e Saúde Ocupacional (SGSST). Essas atividades de prevenção precisam ser avaliadas para verificar sua eficácia e consequentemente estabelecer estratégias confiáveis de melhoria. Consequentemente, a avaliação de desempenho é considerada essencial no avanço do sistema e seus indicadores devem mensurar as particularidades dos riscos no contexto da empresa permitindo definir os planos de ação. Por tanto, caracterizar o tipo de avaliação e os indicadores de desempenho foi o objetivo deste artigo. Na pesquisa utilizou-se o ProKnow-C, realizando a análise sistêmica que identificou e explorou as características dos métodos aplicados. Foi verificado que 11 artigos utilizaram indicadores individuais ou isolados para medir o desempenho, 14 aplicaram um conjunto de indicadores. Os sistemas de avaliação aplicados consideram-se genéricos, por não se ajustar às particularidades da organização. Identificou-se uma lacuna de pesquisa em relação aos indicadores usados para avaliar o SGSST, por ser genéricos podem não oferecer informação precisa da situação do SGSST, isso pode levar a erros na definição de estratégias de melhoria. Igualmente, há ausência de estruturas para definir indicadores de desempenho ajustados às características da organização. Além disso, é necessário definir procedimentos de monitoramento para os indicadores, permitindo responder de forma eficaz ao controle dos riscos ocupacionais e contribuir na melhoria contínua da organização.
Palavras-chave
Abstract
Ergonomics is related to protecting workers' health, involving the physical, cognitive and organizational domains, achieving a systemic approach to all aspects of human activity. In the same sense as the activities of the Occupational Health and Safety Management System (SGSST). These prevention activities need to be evaluated to verify their effectiveness and consequently establish reliable improvement strategies. Consequently, performance assessment is considered essential in the advancement of the system and its indicators must measure the particularities of risks in the context of the company, allowing action plans to be defined. Therefore, characterizing the type of evaluation and performance indicators was the objective of this article. In the research, ProKnow-C was used, carrying out a systemic analysis that identified and explored the characteristics of the methods applied. It was found that 11 articles used individual or isolated indicators to measure performance, 14 applied a set of indicators. The evaluation systems applied are considered generic, as they do not adjust to the particularities of the organization. A research gap was identified in relation to the indicators used to evaluate the SGSST. As they are generic, they may not offer accurate information on the SGSST situation, which can lead to errors in defining improvement strategies. Likewise, there is a lack of structures to define performance indicators adjusted to the characteristics of the organization. Furthermore, it is necessary to define monitoring procedures for the indicators, allowing to respond effectively to the control of occupational risks and contribute to the continuous improvement of the organization.
Translation version DOI: https://doi.org/10.4322/rae.v15n2.e202109.en
Keywords
References
Ai Lin Teo, E., & Yean Yng Ling, F. (2006). Developing a model to measure the
effectiveness of safety management systems of construction sites. Building and Environment,
41(11), 1584–1592. https://doi.org/10.1016/j.buildenv.2005.06.005
Aksorn, T., & Hadikusumo, B. H. W. (2008). Measuring effectiveness of safety programmes
in the Thai construction industry. Construction Management and Economics, 26(4), 409–421.
https://doi.org/10.1080/01446190801918722
Bourne, M., Mills, J., Wilcox, M., Neely, A., & Platts, K. (2000). Designing, implementing
and updating performance measurement systems. International Journal of Operations &
Production Management, 20(7), 754–771. https://doi.org/10.1108/01443570010330739
Cagno, E., Micheli, G. J. L., & Perotti, S. (2011). Identification of OHS-related factors and
interactions among those and OHS performance in SMEs. Safety Science, 49(2), 216–225.
https://doi.org/10.1016/j.ssci.2010.08.002
Cameron, I., & Duff, R. (2007). Use of performance measurement and goal setting to improve
construction managers’ focus on health and safety. Construction Management and
Economics, 25(8), 869–881. https://doi.org/10.1080/01446190701268848
Cardoso, T. L., Ensslin, S. R., Ensslin, L., Ripoll-Feliu, V. M., & Dutra, A. (2015). Reflexões
para avanço na área de Avaliação e Gestão do Desempenho das universidades: uma análise da
literatura científica. Seminários Em Administração (XVIII SEMEAD).
https://doi.org/http://sistema.semead.com.br/18semead/resultado/trabalhosPDF/205.pdf
Carlucci, D. (2010). Evaluating and selecting key performance indicators: an ANP-based
model. Measuring Business Excellence, 14(2), 66–76.
https://doi.org/10.1108/13683041011047876
Chang, J. I., & Liang, C.-L. (2009). Performance evaluation of process safety management
systems of paint manufacturing facilities. Journal of Loss Prevention in the Process
Industries, 22(4), 398–402. https://doi.org/10.1016/j.jlp.2009.02.004
Choudhry, R. M., Fang, D., & Mohamed, S. (2007). The nature of safety culture: A survey of
the state-of-the-art. Safety Science, 45(10), 993–1012.
https://doi.org/10.1016/j.ssci.2006.09.003
Cooper, M. D., & Phillips, R. A. (2004). Exploratory analysis of the safety climate and safety
behavior relationship. Journal of Safety Research, 35(5), 497–512.
https://doi.org/10.1016/j.jsr.2004.08.004
De Oliveira Lacerda, R. T., Ensslin, L., & Ensslin, S. R. (2014). Research opportunities in
strategic management field: A performance measurement approach. International Journal of
Business Performance Management, 15(2), 158–174.
https://doi.org/10.1504/IJBPM.2014.060165
Dutra, A., Ripoll-Feliu, V. ., Fillol, A. ., Ensslin, S. ., & Ensslin, L. (2015). The construction
of knowledge from the scientific literature about the theme seaport performance evaluation.
International Journal of Productivity and Performance Management, 64(2), 243–269.
https://doi.org/10.1108/IJRDM-04-2015-0056
Ensslin, L, Ensslin, S. ., Dutra, A., Nunes, N. ., & Reis, C. (2017). BPM governance: a
literature analysis of performance evaluation. Business Process Management Journal, 23(1),
71–86. https://doi.org/10.1108/BPMJ-11-2015-0159
Ensslin, Leonardo, Ensslin, S. R., & Pacheco, G. C. (2012). Um estudo sobre segurança em
15
estádios de futebol baseado na análise bibliométrica da literatura internacional A study about
safety in football stadiums based on bibliometric analysis of international literature.
Perspectivas Em Ciência de Informação, 17(2), 71–91. https://doi.org/10.1590/S1413-
99362012000200006
Ensslin, S. R., Ensslin, L., Imlau, J. M., & Chaves, L. C. (2014). Processo de Mapeamento das
Publicações Científicas de um Tema : Portfólio Bibliográfico e Análise Bibliométrica sobre
avaliação de desempenho de cooperativas de produção agropecuária. Revista de Economia e
Sociologia Rural, 52(3), 587–608. https://doi.org/10.1590/S0103-20032014000300010
F.W. Guldenmund. (2000). The nature of safety culture : a review of theory and research.
Safety Science, 34, 215–257. https://doi.org/10.1016/S0925-7535(00)00014-X
Fernández-Muñiz, B., Montes-Peón, J. M., & Vázquez-Ordás, C. J. (2007a). Safety culture:
Analysis of the causal relationships between its key dimensions. Journal of Safety Research,
38(6), 627–641. https://doi.org/10.1016/j.jsr.2007.09.001
Fernández-Muñiz, B., Montes-Peón, J. M., & Vázquez-Ordás, C. J. (2007b). Safety
management system: Development and validation of a multidimensional scale. Journal of
Loss Prevention in the Process Industries, 20(1), 52–68.
https://doi.org/10.1016/j.jlp.2006.10.002
Fernández-Muñiz, B., Montes-Peón, J. M., & Vázquez-Ordás, C. J. (2014). Safety leadership,
risk management and safety performance in Spanish firms. Safety Science, 70, 295–307.
https://doi.org/10.1016/j.ssci.2014.07.010
Flin, R., Mearns, K., O’Connor, P., & Bryden, R. (2000). Measuring safety climate:
Identifying the common features. Safety Science, 34(1–3), 177–192.
https://doi.org/10.1016/S0925-7535(00)00012-6
Granerud, R. L., & Rocha, R. S. (2011). Organisational learning and continuous improvement
of health and safety in certified manufacturers. Safety Science, 49(7), 1030–1039.
https://doi.org/10.1016/j.ssci.2011.01.009
Hale, A. R., Heming, B. H. J., Carthey, J., & Kirwan, B. (1997). Modelling of safety
management systems. Safety Science, 26(1–2), 121–140. https://doi.org/10.1016/S0925-
7535(97)00034-9
IEA. (2019). International Ergonomics Association. Definition and Domains of Ergonomics.
http://www.iea.cc
Iida, I., & Buarque, L. (2016). Ergonomia: Projeto e produção (3rd ed.). Blucher.
ILO. (2001). Guidelines on occupational safety and health management systems. OLI-OSH
2001.
ISO. (2018). ISO 45001:2018 - Occupational health and safety management systems —
Requirements with guidance for use (p. 47).
Law, W. K., Chan, a. H. S., & Pun, K. F. (2006). Prioritising the safety management
elements. Industrial Management & Data Systems, 106(6), 778–792.
https://doi.org/10.1108/02635570610671470
Neely, A. (1999). The performance measurement revolution: why now and what next?
International Journal of Operations & Production Management, 19(2), 205–228.
https://doi.org/10.1108/01443579910247437
Neely, A., Gregory, M., & Platts, K. W. (1995). Performance measurement system design: a
literature review and research agenda. International Journal of Operations & Production
Management, 15(4), 80–116. https://doi.org/10.1108/01443570510633639
Nudurupati, S. S., Bititci, U. S., Kumar, V., & Chan, F. T. S. (2011). State of the art literature
review on performance measurement. Computers and Industrial Engineering, 60(2), 279–
290. https://doi.org/10.1016/j.cie.2010.11.010
Podgórski, D. (2015). Measuring operational performance of OSH management system - A
demonstration of AHP-based selection of leading key performance indicators. Safety Science,
16
73, 146–166. https://doi.org/10.1016/j.ssci.2014.11.018
Ramli, A. A., Watada, J., & Pedrycz, W. (2011). Possibilistic regression analysis of influential
factors for occupational health and safety management systems. Safety Science, 49(8–9),
1110–1117. https://doi.org/10.1016/j.ssci.2011.02.014
Robson, L. S., Clarke, J. A., Cullen, K., Bielecky, A., Severin, C., Bigelow, P. L., Irvin, E.,
Culyer, A., & Mahood, Q. (2007). The effectiveness of occupational health and safety
management system interventions: A systematic review. Safety Science, 45(3), 329–353.
https://doi.org/10.1016/j.ssci.2006.07.003
Robson, L. S., Macdonald, S., Van Eerd, D. L., Gray, G. C., & Bigelow, P. L. (2010).
Something might be missing from occupational health and safety audits: findings from a
content validity analysis of five audit instruments. Journal of Occupational and
Environmental Medicine / American College of Occupational and Environmental Medicine,
52(5), 536–543. https://doi.org/10.1097/JOM.0b013e3181dbc87c
Saurin, T. A., & Carim Júnior, G. C. (2011). Evaluation and improvement of a method for
assessing HSMS from the resilience engineering perspective: A case study of an electricity
distributor. Safety Science, 49(2), 355–368. https://doi.org/10.1016/j.ssci.2010.09.017
Shahin, A., & Mahbod, M. A. (2007). Prioritization of key performance indicators: An
integration of analytical hierarchy process and goal setting. International Journal of
Productivity and Performance Management, 56(3), 226–240.
https://doi.org/10.1108/17410400710731437
Thomson Corporation. (2018). EndNote X9. Thomson Corporation.
Valmorbida, S. M. ., Ensslin, S. ., Ensslin, L., & Ripoll-Feliu, V. . (2016). Rankings
universitários mundiais: que dizem os estudos internacionais? REICE. Revista
Iberoamericana Sobre Calidad, Eficacia y Cambio En Educación, 14(2), 1–25.
https://doi.org/10.15366/reice2016.14.2.001
Valmorbida, S. M. I., & Ensslin, S. R. (2015). Avaliação de Desempenho de Rankings
Universitários: Revisão da Literatura e diretrizes para futuras investigações. Anais Do
Encontro Da ANPAD (XXXIX EnANPAD 2015).
Zeng, S. X., Xie, X. M., Tam, C. M., & Shen, L. Y. (2011). An empirical examination of
benefits from implementing integrated management systems (IMS). Total Quality
Management & Business Excellence, 22(September), 173–186.
https://doi.org/10.1080/14783363.2010.530797
