The subject of this work has its roots in the so called Schroedginer Bridge Problem (SBP) which asks for the most likely distribution of Brownian particles in their passage between observed empirical marginal distributions at two distinct points in time. Renewed interest in this problem was sparked by a reformulation in the language of stochastic control. In earlier works, presented as Part I and Part II, we explored a generalization of the original SBP that amounts to optimal steering of linear stochastic dynamical systems between state-distributions, at two points in time, under full state feedback. In these works the cost was quadratic in the control input, i.e., control energy. The purpose of the present work is to detail the technical steps in extending the framework to the case where a quadratic cost in the state is also present. Thus, the main contribution is to derive the optimal control in this case which in fact is given in closed-form (Theorem 1). In the zero-noise limit, we also obtain the solution of a (deterministic) mass transport problem with general quadratic cost.

Optimal Steering of a Linear Stochastic System to a Final Probability Distribution - Part III

Michele Pavon
2018

Abstract

The subject of this work has its roots in the so called Schroedginer Bridge Problem (SBP) which asks for the most likely distribution of Brownian particles in their passage between observed empirical marginal distributions at two distinct points in time. Renewed interest in this problem was sparked by a reformulation in the language of stochastic control. In earlier works, presented as Part I and Part II, we explored a generalization of the original SBP that amounts to optimal steering of linear stochastic dynamical systems between state-distributions, at two points in time, under full state feedback. In these works the cost was quadratic in the control input, i.e., control energy. The purpose of the present work is to detail the technical steps in extending the framework to the case where a quadratic cost in the state is also present. Thus, the main contribution is to derive the optimal control in this case which in fact is given in closed-form (Theorem 1). In the zero-noise limit, we also obtain the solution of a (deterministic) mass transport problem with general quadratic cost.
File in questo prodotto:
File Dimensione Formato  
LinearC_final.pdf

accesso aperto

Descrizione: Articolo principale
Tipologia: Preprint (submitted version)
Licenza: Accesso libero
Dimensione 494.66 kB
Formato Adobe PDF
494.66 kB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11577/3281225
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 42
  • ???jsp.display-item.citation.isi??? 29
social impact