Home Study on comprehensive evaluation method of mental workload level
Article
Licensed
Unlicensed Requires Authentication

Study on comprehensive evaluation method of mental workload level

  • Shengyuan Yan , Fengjiao Li EMAIL logo , Kai Yao and Yingying Wei
Published/Copyright: July 25, 2024
Become an author with De Gruyter Brill

Abstract

Mental workload has an important impact on the human performance of ship operators. The purpose of this study is to develop an evaluation method to evaluate the ship operator’s mental workload. First, an evaluation index system was constructed, and the DEMATEL (decision-making trial and evaluation laboratory) method was used to determine the relative weight of each index. Then, the fuzzy evaluation method was used to calculate the mental workload of ship operator based on the evaluation value and relative weight of indexes. The evaluation result of the developed method showed that the ship operators’ mental workload were 3.78 and 2.99 under tasks 1 and 2, and the ship operators’ mental workloads were at the ‘very high’ and ‘high’ levels based on the maximum membership principle. Also, the evaluation result of the developed method was consistent with the evaluation results of subjective mental workload assessment technique. It proves that the developed method can effectively evaluate the ship operator’s mental workload level.


Corresponding author: Fengjiao Li, College of Mechanical and Electrical Engineering, Harbin Engineering University, 150001, Harbin, Heilongjiang, China, E-mail:

Acknowledgments

Thanks to the reviewers for their valuable comments and suggestions.

  1. Research ethics: The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board of Harbin engineering university.

  2. Author contributions: Conceptualization, S.Y., F.L. and K.Y.; methodology, S.Y., F.L.; validation, S.Y., F.L.,K.Y., and Y.W.; writing—original draft preparation, F.L.; supervision, S.Y. The authors have accepted responsibility for the entire content of this manuscript and approved its submission.

  3. Competing interest: The authors declare no conflict of interest.

  4. Research funding: None declared.

  5. Data availability: Not applicable.

References

Baker, C.C. and Seah, A.K. (2004). Maritime accidents and human performance: the statistical trail. MarTech Conference, Singapore. Available at: https://www.abc.net.au/science/articles/2009/03/31/2530686.htm.Search in Google Scholar

Benedetto, S., Pedrotti, M., Minin, L., Baccino, T., Re, A., and Montanari, R. (2011). Driver workload and eye blink duration. Transport. Res. Part F Traffic Psychol. Behav. 14: 199–208, https://doi.org/10.1016/j.trf.2010.12.001.Search in Google Scholar

Boucsein, W. (2012). Electrodermal activity. Springer US, Boston, MA.10.1007/978-1-4614-1126-0Search in Google Scholar

Brookings, J.B., Wilson, G.F., and Swain, C.R. (1996). Psychophysiological responses to changes in workload during simulated air traffic control. Biol. Psychol. 42: 361–377, https://doi.org/10.1016/0301-0511(95)05167-8.Search in Google Scholar PubMed

Gawron, V.J. (2008). Human performance, workload, and situational awareness measures handbook. CRC Press, Boca Raton.10.1201/9781420064506Search in Google Scholar

Hart, S.G. and Staveland, L.E. (1988). Development of NASA-TLX (task load index): results of empirical and theoretical research. In: Advances in psychology. North-Holland, Amsterdam, pp. 139–183. Available at: https://doi.org/10.1016/S0166-4115(08)62386-9.Search in Google Scholar

Jo, S., Myung, R., and Yoon, D. (2012). Quantitative prediction of mental workload with the ACT-R cognitive architecture. Int. J. Industr. Ergon. 42: 359–370, https://doi.org/10.1016/j.ergon.2012.03.004.Search in Google Scholar

Kim, A.R., Park, J., Kim, Y., Kim, J., and Seong, P.H. (2017). Quantification of performance shaping factors (PSFs)’ weightings for human reliability analysis (HRA) of low power and shutdown (LPSD) operations. Ann. Nucl. Energy 101: 375–382, https://doi.org/10.1016/j.anucene.2016.11.009.Search in Google Scholar

Luximon, A. and Goonetilleke, R.S. (2001). Simplified subjective workload assessment technique. Ergonomics 44: 229–243, https://doi.org/10.1080/00140130010000901.Search in Google Scholar PubMed

Reid, G.B. and Nygren, T.E. (1988). The subjective workload assessment technique: a scaling procedure for measuring mental workload. In: Advances in psychology. North-Holland, Amsterdam, pp. 185–218. Available at: https://doi.org/10.1016/S0166-4115(08)62387-0.Search in Google Scholar

Ryu, K. and Myung, R. (2005). Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic. Inter. J. Industr. Ergon. 35: 991–1009, https://doi.org/10.1016/j.ergon.2005.04.005.Search in Google Scholar

Si, S.L., You, X.Y., Liu, H.C., and Zhang, P. (2018). DEMATEL technique: a systematic review of the state-of-the-art literature on methodologies and applications. Math. Probl. Eng. 2018(1): 3696457, https://doi.org/10.1155/2018/3696457.Search in Google Scholar

Smidovnik, T. and Groselj, P. (2023). Solution for convergence problem in DEMATEL method: DEMATEL of finite sum of influences. Symmetry 15(7): 1357, https://doi.org/10.3390/sym15071357.Search in Google Scholar

Tecce, J.J. (2001). Psychophysiology: human behavior and physiological response, 4th edition. Int. J. Psychophysiol. 40: 89–91, https://doi.org/10.1016/s0167-8760(00)00150-1.Search in Google Scholar

Thayer, R.E. (1986). Activation-deactivation adjective check list: current overview and structural analysis. Psychol. Rep. 58: 607–614, https://doi.org/10.2466/pr0.1986.58.2.607.Search in Google Scholar

Van Orden, K.F., Jung, T.P., and Makeig, S. (2000). Combined eye activity measures accurately estimate changes in sustained visual task performance. Biol. Psychol. 52: 221–240, https://doi.org/10.1016/s0301-0511(99)00043-5.Search in Google Scholar PubMed

Watson, D., Clark, L.A., and Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: the PANAS scales. J. Pers. Soc. Psychol. 54: 1063–1070, https://doi.org/10.1037/0022-3514.54.6.1063.Search in Google Scholar

Wei, Z., Wanyan, X., and Zhuang, D. (2014). Measurement and evaluation of mental workload for aircraft cockpit display interface. Journal of Beijing University of Aeronautics and Astronautics 40: 86–91, https://doi.org/10.13700/j.bh.1001-5965.2014.01.010.Search in Google Scholar

Wierwille, W.W. and Casali, J.G. (1983). A validated rating scale for global mental workload measurement applications. Proc. Human Fact. Soc. Annu. Meet. 27, 129–133, https://doi.org/10.1177/154193128302700203.Search in Google Scholar

Yan, S.Y., Tran, C.C., Wei, Y.Y., and Habiyaremye, J.L. (2019a). Driver’s mental workload prediction model based on physiological indices. Int. J. Occup. Saf. Ergon. 25: 476–484, https://doi.org/10.1080/10803548.2017.1368951.Search in Google Scholar PubMed

Yan, S.Y., Wei, Y.Y., and Tran, C.C. (2019b). Evaluation and prediction mental workload in user interface of maritime operations using eye response. Int. J. Industr. Ergon. 71: 117–127, https://doi.org/10.1016/j.ergon.2019.03.002.Search in Google Scholar

Received: 2024-01-12
Accepted: 2024-06-20
Published Online: 2024-07-25
Published in Print: 2024-08-27

© 2024 Walter de Gruyter GmbH, Berlin/Boston

Downloaded on 11.9.2025 from https://www.degruyterbrill.com/document/doi/10.1515/kern-2024-0004/html
Scroll to top button