Nonlinear system categorization for structural data mining with state space models
-
Hermann Klein
Hermann Klein graduated at the University of Siegen in 2021 with a Master of Science in Mechanical Engineering and worked as a test engineer in industry. In 2022 he has joined Prof. Nelles’ research group for Automatic Control – Mechatronics at the Department of Mechanical Engineering at the University of Siegen. His research interests are nonlinear system identification and state space modeling., Max Schüssler
and Oliver Nelles Max Schüssler was a research assistant with the working group Automatic Control – Mechatronics of Prof. Nelles until 2022 and is currently employed as Data Scientist in the industry. He received his doctor’s degree in 2022 at the University of Siegen. In his work, he focuses on machine learning perspectives for nonlinear system identification and adjacent research fields. Oliver Nelles is Professor at the University of Siegen in the Department of Mechanical Engineering and chair of Automatic Control – Mechatronics. He received his doctor’s degree in 1999 at the Technical University of Darmstadt. His key research topics are nonlinear system identification, design of experiments, metamodeling, and local model networks.
Abstract
Data-driven state space models allow accurate descriptions of nonlinear systems, as they represent a general and abstract modeling approach. With the help of the model structure according to the canonical controllable form, it is possible to determine the main nonlinear influences on the process and thus, carry out learning-based categorization. Within this contribution, we explain and test categorization with the help of the Local Model State Space Network and show how conclusions about the underlying process can be drawn. Especially for time-variant behavior, the method provides the possibility to categorize the process in terms of its nonlinear characteristics to enable fault diagnosis.
Zusammenfassung
Datengetriebene Zustandsraummodelle ermöglichen die präzise Beschreibung nichtlinearer Systeme, indem sie einen allgemeinen und abstrakten Modellbildungsansatz verfolgen. Mit Hilfe der Modellstruktur entsprechend der Regelungsnormalform ist die Bestimmung der nichtlinearen Haupteinflussgrößen auf den Prozess und dadurch die lernbasierte Kategorisierung möglich. Innerhalb dieses Beitrags erklären und testen wir die Kategorisierung mit Hilfe des Local Model State Space Networks und legen dar, wie Rückschlüsse über den zu Grunde liegenden Prozess gezogen werden können. Insbesondere bei zeitvariantem Verhalten bietet das Verfahren die Möglichkeit, den Prozess hinsichtlich seiner nichtlinearen Charakteristik zu kategorisieren, um eine Fehlerdiagnose zu ermöglichen.
About the authors

Hermann Klein graduated at the University of Siegen in 2021 with a Master of Science in Mechanical Engineering and worked as a test engineer in industry. In 2022 he has joined Prof. Nelles’ research group for Automatic Control – Mechatronics at the Department of Mechanical Engineering at the University of Siegen. His research interests are nonlinear system identification and state space modeling.

Max Schüssler was a research assistant with the working group Automatic Control – Mechatronics of Prof. Nelles until 2022 and is currently employed as Data Scientist in the industry. He received his doctor’s degree in 2022 at the University of Siegen. In his work, he focuses on machine learning perspectives for nonlinear system identification and adjacent research fields.

Oliver Nelles is Professor at the University of Siegen in the Department of Mechanical Engineering and chair of Automatic Control – Mechatronics. He received his doctor’s degree in 1999 at the Technical University of Darmstadt. His key research topics are nonlinear system identification, design of experiments, metamodeling, and local model networks.
-
Research ethics: Not applicable.
-
Informed consent: Not applicable.
-
Author contributions: All the authors have accepted responsibility for the entire content of this submitted manuscript and approved submission.
-
Use of Large Language Models, AI and Machine Learning Tools: None declared.
-
Conflict of interest: The authors declare no conflict of interest regarding this article.
-
Research funding: None declared.
-
Data availability: Not applicable.
References
[1] T. Hastie, et al.., The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer Series in Statistics, New York, Springer, 2009.10.1007/978-0-387-84858-7Search in Google Scholar
[2] O. Nelles, Nonlinear System Identification from Classical Approaches to Neural Networks, Fuzzy Models, and Gaussian Processes, 2nd ed. Cham, Springer International Publishing; Imprint: Springer, 2020, Nelles 2020.10.1007/978-3-030-47439-3Search in Google Scholar
[3] R. T. Q. Chen, et al.., “Neural ordinary differential equations,” in Proceedings of the 32nd International Conference on Neural Information Processing Systems. NIPS’18, Montréal, Canada, Curran Associates Inc., 2018, pp. 6572–6583.Search in Google Scholar
[4] J. A. K. Suykens, B. L. R. De Moor, and J. Vandewalle, “Nonlinear system identification using neural state space models, applicable to robust control design,” Int. J. Control, vol. 62, no. 1, pp. 129–152, 1995, https://doi.org/10.1080/00207179508921536.Search in Google Scholar
[5] T. A. Johansen, R. Shorten, and R. Murray-Smith, “On the interpretation and identification of dynamic Takagi-Sugeno fuzzy models,” IEEE Trans. Fuzzy Syst., vol. 8, no. 3, pp. 297–313, 2000, https://doi.org/10.1109/91.855918.Search in Google Scholar
[6] R. Toth, Modeling and Identification of Linear Parameter-Varying Systems. English. Lecture Notes in Control and Information Sciences, Germany, Springer, 2010.10.1007/978-3-642-13812-6Search in Google Scholar
[7] M. Schüssler, “Machine learning with nonlinear state space models,” Ph.D. thesis, Universität Siegen, 2022.10.1515/auto-2022-0089Search in Google Scholar
[8] A. Kroll, “Identification of functional fuzzy models using multidimensional reference fuzzy sets,” Fuzzy Sets Syst., vol. 80, no. 2, pp. 149–158, 1996, https://doi.org/10.1016/0165-0114(95)00140-9.Search in Google Scholar
[9] D. E. Gustafson and W. C. Kessel, “Fuzzy clustering with a fuzzy covariance matrix,” in 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes, 1978, pp. 761–766.10.1109/CDC.1978.268028Search in Google Scholar
[10] S. L. Brunton and J. Nathan Kutz, Data-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control. 1st, USA, Cambridge University Press, 2019.10.1017/9781108380690Search in Google Scholar
[11] S. Becker, et al.., “Predicting ordinary differential equations with transformers,” in Proceedings of the 40th International Conference on Machine Learning. ICML’23, Honolulu, Hawaii, USA, JMLR.org, 2023.Search in Google Scholar
[12] F. Sun, et al.., “Physics-informed spline learning for nonlinear dynamics discovery,” in Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI-21, Main Track. International Joint Conferences on Artificial Intelligence Organization, Z.-H. Zhou, Ed., 2021, pp. 2054–2061.10.24963/ijcai.2021/283Search in Google Scholar
[13] G. N. Saridis and R. F. Hofstadter, “A pattern recognition approach to the classification of nonlinear systems,” in IEEE Transactions on Systems, Man, and Cybernetics SMC-4.4, 1974, pp. 362–371.10.1109/TSMC.1974.5408457Search in Google Scholar
[14] L. Galleani, L. L. Presti, and A. D. Stefano, “A method for nonlinear system classification in the time–frequency plane,” Signal Process., vol. 65, no. 1, pp. 147–153, 1998, https://doi.org/10.1016/s0165-1684(98)00029-2.Search in Google Scholar
[15] J. Hahn and T. F. Edgar, “A Gramian based approach to nonlinearity quantification and model classification,” Ind. Eng. Chem. Res., vol. 40, no. 24, pp. 5724–5731, 2001. https://doi.org/10.1021/ie010155v.Search in Google Scholar
[16] D. Rotondo, V. Puig, F. Nejjari, and M. Witczak, “Automated generation and comparison of Takagi-Sugeno and polytopic quasi-LPV models,” Fuzzy Sets Syst., vol. 277, pp. 44–64, 2015, https://doi.org/10.1016/j.fss.2015.02.002.Search in Google Scholar
[17] Y.-J. Wang and C.-T. Lin, “Runge–Kutta neural network for identification of dynamical systems in high accuracy,” IEEE Trans. Neural Netw., vol. 9, no. 2, pp. 294–307, 1998, https://doi.org/10.1109/72.661124.Search in Google Scholar PubMed
[18] T. McKelvey, H. Akcay, and L. Ljung, “Subspace-based multivariable system identification from frequency response data,” IEEE Trans. Autom. Control, vol. 41, no. 7, pp. 960–979, 1996, https://doi.org/10.1109/9.508900.Search in Google Scholar
[19] D. Luenberger, “Canonical forms for linear multivariable systems,” in IEEE Transactions on Automatic Control AC-12, 1967, pp. 290–293.10.1109/TAC.1967.1098584Search in Google Scholar
[20] K. Worden, C. R. Farrar, J. Haywood, and M. Todd, “A review of nonlinear dynamics applications to structural health monitoring,” Struct. Control Health Monit., vol. 15, no. 4, pp. 540–567, 2008, https://doi.org/10.1002/stc.215.Search in Google Scholar
© 2025 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Editorial
- Selected contributions from the workshops “Computational Intelligence” in 2023 and 2024
- Methods
- Nonlinear system categorization for structural data mining with state space models
- Incorporation of structural properties of the response surface into oblique model trees
- Takagi-Sugeno based model reference control for wind turbine systems in frequency containment scenarios
- On autoregressive deep learning models for day-ahead wind power forecasts with irregular shutdowns due to redispatching
- Applications
- Efficiently determining the effect of data set size on autoencoder-based metamodels for structural design optimization
- Kalibriermodellerstellung und Merkmalsselektion für die mikromagnetische Materialcharakterisierung mittels maschineller Lernverfahren
- Investigating quality inconsistencies in the ultra-high performance concrete manufacturing process using a search-space constrained non-dominated sorting genetic algorithm II
- EAP4EMSIG – enhancing event-driven microscopy for microfluidic single-cell analysis
Articles in the same Issue
- Frontmatter
- Editorial
- Selected contributions from the workshops “Computational Intelligence” in 2023 and 2024
- Methods
- Nonlinear system categorization for structural data mining with state space models
- Incorporation of structural properties of the response surface into oblique model trees
- Takagi-Sugeno based model reference control for wind turbine systems in frequency containment scenarios
- On autoregressive deep learning models for day-ahead wind power forecasts with irregular shutdowns due to redispatching
- Applications
- Efficiently determining the effect of data set size on autoencoder-based metamodels for structural design optimization
- Kalibriermodellerstellung und Merkmalsselektion für die mikromagnetische Materialcharakterisierung mittels maschineller Lernverfahren
- Investigating quality inconsistencies in the ultra-high performance concrete manufacturing process using a search-space constrained non-dominated sorting genetic algorithm II
- EAP4EMSIG – enhancing event-driven microscopy for microfluidic single-cell analysis