Robust stability of moving horizon estimation for continuous-time systems
-
Julian D. Schiller
and Matthias A. Müller
Abstract
We consider a moving horizon estimation (MHE) scheme involving a discounted least squares objective for general nonlinear continuous-time systems. Provided that the system is detectable (incrementally integral input/output-to-state stable, i-iIOSS), we show that there exists a sufficiently long estimation horizon that guarantees robust global exponential stability of the estimation error in a time-discounted L2-to-L∞ sense. In addition, we show that i-iIOSS Lyapunov functions can be efficiently constructed by verifying certain linear matrix inequality conditions. In combination, we propose a flexible Lyapunov-based MHE framework in continuous time, which particularly offers more tuning possibilities than its discrete-time analog, and provide sufficient conditions for stability that can be easily verified in practice. Our results are illustrated by a numerical example.
Zusammenfassung
Wir betrachten ein Verfahren zur Zustandsschätzung auf bewegtem Horizont (moving horizon estimation, MHE) für allgemeine nichtlineare zeitkontinuierliche Systeme, wobei wir eine quadratische Kostenfunktion mit Zeitdiskontierung verwenden. Unter der Voraussetzung einer speziellen Entdeckbarkeitseigenschaft (incremental integral input/output-to-state stability, i-iIOSS) zeigen wir, dass es einen hinreichend langen Schätzhorizont gibt, der robuste globale exponentielle Stabilität des Schätzfehlers im Sinne einer zeitdiskontierten L2-zu-L∞ Fehlerschranke garantiert. Darüber hinaus zeigen wir, dass i-iIOSS Lyapunov-Funktionen effizient konstruiert werden können, indem bestimmte lineare Matrix-Ungleichungen überprüft werden. In Kombination präsentieren wir ein flexibles Lyapunov-basiertes zeitkontinuierliches MHE-Schema, das insbesondere im Vergleich mit seinem zeitdiskreten Analogon mehr Einstellmöglichkeiten bietet, und liefern hinreichende Stabilitätsbedingungen, die in der Praxis leicht überprüft werden können. Unsere Ergebnisse werden anhand eines numerischen Beispiels veranschaulicht.
About the authors

Julian D. Schiller received his Master degree in Mechatronics from the Leibniz University Hannover, Germany, in 2019. Since then, he has been a research assistant at the Institute of Automatic Control, Leibniz University Hannover, where he is currently working on his Ph.D. under the supervision of Prof. Matthias A. Müller. His research interests are in the area of optimization-based state estimation and the control of nonlinear systems.

Matthias A. Müller received a Diploma degree in Engineering Cybernetics from the University of Stuttgart, Germany, and an M.S. in Electrical and Computer Engineering from the University of Illinois at Urbana-Champaign, US, both in 2009. In 2014, he obtained a Ph.D. in Mechanical Engineering, also from the University of Stuttgart, Germany, for which he received the 2015 European Ph.D. award on control for complex and heterogeneous systems. Since 2019, he is director of the Institute of Automatic Control and full professor at the Leibniz University Hannover, Germany. He obtained an ERC Starting Grant in 2020 and is recipient of the inaugural Brockett-Willems Outstanding Paper Award for the best paper published in Systems & Control Letters in the period 2014–2018. His research interests include nonlinear control and estimation, model predictive control, and data-/learning-based control, with application in different fields including biomedical engineering.
-
Research ethics: Not applicable.
-
Author contributions: The authors have accepted responsibility for the entire content of this manuscript and approved its submission.
-
Competing interests: The authors state no conflict of interest.
-
Research funding: This work was funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) – 426459964.
-
Data availability: Not applicable.
A Proofs
A.1 Proof of Proposition 1
Proof
The proof is straightforward and follows by noting that
Consequently, using the fact that a + b ≤ max{2a, 2b} for a, b ≥ 0, the RGAS property from (3) implies that
which is equivalent to (4) by setting
When the state estimator is additionally RGES, we can exploit in (34) that β(s) ≥ C1s
r
and β
x
(s) ≤ C2s
r
with C1, C2, r from Definition 2, which yields
A.2 Proof of Proposition 2
Proof
Given any t ≥ 0 and its corresponding sampling time t
i
= k(t), let
where the last inequality follows by exploiting that
By Cauchy–Schwarz and Young’s inequality, we have
and
Then,
By optimality, it follows that
where the last equality follows by a change of coordinates. In combination, we obtain
Using
A.3 Proof of Theorem 2
Proof
For any pair of points
Given any
At any fixed time t = t⋆ ≥ 0, let us consider the following smoothly parameterized paths for s ∈ [0, 1]: the path of states c(t, s) ∈ Ξ (x1(t), x2(t)) and the paths of disturbances ω(t, s) = w1(t) + s(w2(t) − w1(t)). For t ∈ [t⋆, t⋆ + ϵ) (with ϵ > 0 arbitrarily small to guarantee local existence of solutions and continuity of u, w over t ∈ [t⋆, t⋆ + ϵ)) and each fixed s ∈ [0, 1], the path c(t, s) evolves according to (1) such that
where ζ(t, s) satisfies y1(t) = ζ(t, 0) and y2(t) = ζ(t, 1) for each t ∈ [t⋆, t⋆ + ϵ). Differentiating (43) with respect to s ∈ [0, 1] yields (after interchanging the order of differentiation of t and s)
for all t ∈ [t⋆, t⋆ + ϵ) using the substitutions δ
x
≔ dc/ds(t, s), δ
w
≔ dω/ds(t, s), and δ
y
≔ dζ/ds(t, s), and where the matrices A, B, C, D are the linearizations of f and h as in (30) evaluated at (c(t, s), u(t), ω(t, s)). Assuming that
for all t ∈ [t⋆, t⋆ + ϵ). By integrating (45) over s ∈ [0, 1], interchanging integration and differentiation, and defining
for t ∈ [t⋆, t⋆ + ϵ). The integration over t ∈ [t⋆, t⋆ + ϵ) yields
Note that E(c(t, s)) can be interpreted as the Riemannian energy of the path c(t, s). Since P is constant and
By construction of γ and ω (in particular, the fact that their derivatives with respect to s ∈ [0, 1] are constant in s ∈ [0, 1]), it follows that
where the last equality follows since h is affine in (x, w) by Assumption 2 (which implies that C and D are constant in s). Since t⋆ ≥ 0 was arbitrary, using the definition
for each t ≥ 0. Note that U satisfies (5a) with P1 = P2 = P. In what follows, we will show that U also satisfies (5b). To this end, let
Solving for v yields
From the standard comparison theorem, we know that U(x1(t), x2(t)) ≤ v(t) for all t ≥ 0, which establishes (5b) with λ = e−κ. Consequently, U is a quadratic (and hence smooth) i-iIOSS Lyapunov function that satisfies Assumption 1, which finishes this proof. □
References
[1] H. Michalska and D. Q. Mayne, “Moving horizon observers and observer-based control,” IEEE Trans. Autom. Control, vol. 40, no. 6, pp. 995–1006, 1995. https://doi.org/10.1109/9.388677.Search in Google Scholar
[2] J. B. Rawlings, D. Q. Mayne, and M. M. Diehl, Model Predictive Control: Theory, Computation, and Design, 2nd ed. Santa Barbara, CA, USA, Nob Hill Publish., LLC, 2020, 3rd Printing.Search in Google Scholar
[3] A. Alessandri, M. Baglietto, and G. Battistelli, “Moving-horizon state estimation for nonlinear discrete-time systems: new stability results and approximation schemes,” Automatica, vol. 44, no. 7, pp. 1753–1765, 2008. https://doi.org/10.1016/j.automatica.2007.11.020.Search in Google Scholar
[4] C. V. Rao, J. B. Rawlings, and D. Q. Mayne, “Constrained state estimation for nonlinear discrete-time systems: stability and moving horizon approximations,” IEEE Trans. Autom. Control, vol. 48, no. 2, pp. 246–258, 2003. https://doi.org/10.1109/tac.2002.808470.Search in Google Scholar
[5] J. B. Rawlings and L. Ji, “Optimization-based state estimation: current status and some new results,” J. Process Control, vol. 22, no. 8, pp. 1439–1444, 2012. https://doi.org/10.1016/j.jprocont.2012.03.001.Search in Google Scholar
[6] M. A. Müller, “Nonlinear moving horizon estimation in the presence of bounded disturbances,” Automatica, vol. 79, pp. 306–314, 2017. https://doi.org/10.1016/j.automatica.2017.01.033.Search in Google Scholar
[7] D. A. Allan and J. B. Rawlings, “Moving horizon estimation,” in Handbook of Model Predictive Control, S. V. Raković, and W. S. Levine, Eds., Basel, Switzerland, Birkhäuser, 2019, pp. 99–124.10.1007/978-3-319-77489-3_5Search in Google Scholar
[8] D. A. Allan and J. B. Rawlings, “Robust stability of full information estimation,” SIAM J. Control Optim., vol. 59, no. 5, pp. 3472–3497, 2021. https://doi.org/10.1137/20m1329135.Search in Google Scholar
[9] W. Hu, “Generic stability implication from full information estimation to moving-horizon estimation,” IEEE Trans. Autom. Control, pp. 1–8, 2023, https://doi.org/10.1109/TAC.2023.3277315.Search in Google Scholar
[10] S. Knüfer and M. A. Müller, “Robust global exponential stability for moving horizon estimation,” in Proc. IEEE Conf. Decis. Control, 2018, pp. 3477–3482. 10.1109/CDC.2018.8619617Search in Google Scholar
[11] S. Knüfer and M. A. Müller, “Nonlinear full information and moving horizon estimation: robust global asymptotic stability,” Automatica, vol. 150, p. 110603, 2023. https://doi.org/10.1016/j.automatica.2022.110603.Search in Google Scholar
[12] J. D. Schiller, S. Muntwiler, J. Köhler, M. N. Zeilinger, and M. A. Müller, “A Lyapunov function for robust stability of moving horizon estimation,” IEEE Trans. Autom. Control, vol. 68, pp. 7466–7481, 2023. https://doi.org/10.1109/TAC.2023.3280344.Search in Google Scholar
[13] J. D. Schiller and M. A. Müller, “On an integral variant of incremental input/output-to-state stability and its use as a notion of nonlinear detectability,” IEEE Control Syst. Lett., vol. 7, pp. 2341–2346, 2023. https://doi.org/10.1109/lcsys.2023.3286174.Search in Google Scholar
[14] E. D. Sontag, Mathematical Control Theory: Deterministic Finite Dimensional Systems, 2nd ed. New York, NY, USA, Springer, 1990.Search in Google Scholar
[15] J. D. Schiller and M. A. Müller, “Suboptimal nonlinear moving horizon estimation,” IEEE Trans. Autom. Control, vol. 68, no. 4, pp. 2199–2214, 2023. https://doi.org/10.1109/tac.2022.3173937.Search in Google Scholar
[16] L. Praly and Y. Wang, “Stabilization in spite of matched unmodeled dynamics and an equivalent definition of input-to-state stability,” Math. Control. Signals, Syst., vol. 9, no. 1, pp. 1–33, 1996. https://doi.org/10.1007/bf01211516.Search in Google Scholar
[17] D. A. Allan, J. B. Rawlings, and A. R. Teel, “Nonlinear detectability and incremental input/output-to-state stability,” SIAM J. Control Optim., vol. 59, no. 4, pp. 3017–3039, 2021. https://doi.org/10.1137/20m135039x.Search in Google Scholar
[18] F. Forni and R. Sepulchre, “A differential Lyapunov framework for contraction analysis,” IEEE Trans. Autom. Control, vol. 59, no. 3, pp. 614–628, 2014. https://doi.org/10.1109/tac.2013.2285771.Search in Google Scholar
[19] B. T. Lopez and J.-J. E. Slotine, “Adaptive nonlinear control with contraction metrics,” IEEE Control Syst. Lett., vol. 5, no. 1, pp. 205–210, 2021. https://doi.org/10.1109/lcsys.2020.3000190.Search in Google Scholar
[20] I. R. Manchester and J.-J. E. Slotine, “Control contraction metrics: convex and intrinsic criteria for nonlinear feedback design,” IEEE Trans. Autom. Control, vol. 62, no. 6, pp. 3046–3053, 2017. https://doi.org/10.1109/tac.2017.2668380.Search in Google Scholar
[21] I. R. Manchester and J.-J. E. Slotine, “Robust control contraction metrics: a convex approach to nonlinear state-feedback H∞ control,” IEEE Control Syst. Lett., vol. 2, no. 3, pp. 333–338, 2018. https://doi.org/10.1109/lcsys.2018.2836355.Search in Google Scholar
[22] S. Singh, A. Majumdar, J.-J. Slotine, and M. Pavone, “Robust online motion planning via contraction theory and convex optimization,” in Proc. IEEE Int. Conf. Robot. Autom., 2017, pp. 5883–5890. 10.1109/ICRA.2017.7989693Search in Google Scholar
[23] B. Yi, R. Wang, and I. R. Manchester, “Reduced-order nonlinear observers via contraction analysis and convex optimization,” IEEE Trans. Autom. Control, vol. 67, no. 8, pp. 4045–4060, 2022. https://doi.org/10.1109/tac.2021.3115887.Search in Google Scholar
[24] P. A. Parrilo, “Semidefinite programming relaxations for semialgebraic problems,” Math. Program., vol. 96, no. 2, pp. 293–320, 2003. https://doi.org/10.1007/s10107-003-0387-5.Search in Google Scholar
[25] A. Sadeghzadeh and R. Toth, “Improved embedding of nonlinear systems in linear parameter-varying models with polynomial dependence,” IEEE Trans. Control Syst. Technol., vol. 31, no. 1, pp. 70–82, 2023. https://doi.org/10.1109/tcst.2022.3173891.Search in Google Scholar
[26] M. J. Tenny and J. B. Rawlings, “Efficient moving horizon estimation and nonlinear model predictive control,” in Proc. Am. Control Conf., 2002, pp. 4475–4480. 10.1109/ACC.2002.1025355Search in Google Scholar
[27] J. Löfberg, “YALMIP: a toolbox for modeling and optimization in MATLAB,” in IEEE Int. Conf. Robot. Autom., 2004, pp. 284–289. 10.1109/CACSD.2004.1393890Search in Google Scholar
[28] MOSEK ApS, The MOSEK Optimization Toolbox for MATLAB Manual. Version 9.0, 2019 [Online]. Available at: http://docs.mosek.com/9.0/toolbox/index.html.Search in Google Scholar
[29] J. A. E. Andersson, J. Gillis, G. Horn, J. B. Rawlings, and M. Diehl, “CasADi: a software framework for nonlinear optimization and optimal control,” Math. Program. Comput., vol. 11, no. 1, pp. 1–36, 2018. https://doi.org/10.1007/s12532-018-0139-4.Search in Google Scholar
[30] A. Wächter and L. T. Biegler, “On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming,” Math. Program., vol. 106, no. 1, pp. 25–57, 2005. https://doi.org/10.1007/s10107-004-0559-y.Search in Google Scholar
© 2023 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Editorial
- Optimal control – analysis, algorithms and applications
- Methods
- Optimization-based trajectory planning for transport collaboration of heterogeneous systems
- Sensitivity-based distributed model predictive control: synchronous and asynchronous execution compared to ADMM
- Energy-optimal control of adaptive structures
- Robust stability of moving horizon estimation for continuous-time systems
- Applications
- The dynamics of a bicycle on a pump track – first results on modeling and optimal control
- Strategien für den optimalen Betrieb von Pumpspeicherkraftwerken
Articles in the same Issue
- Frontmatter
- Editorial
- Optimal control – analysis, algorithms and applications
- Methods
- Optimization-based trajectory planning for transport collaboration of heterogeneous systems
- Sensitivity-based distributed model predictive control: synchronous and asynchronous execution compared to ADMM
- Energy-optimal control of adaptive structures
- Robust stability of moving horizon estimation for continuous-time systems
- Applications
- The dynamics of a bicycle on a pump track – first results on modeling and optimal control
- Strategien für den optimalen Betrieb von Pumpspeicherkraftwerken