A journal of IEEE and CAA , publishes high-quality papers in English on original theoretical/experimental research and development in all areas of automation
Volume 6 Issue 5
Sep.  2019

IEEE/CAA Journal of Automatica Sinica

  • JCR Impact Factor: 11.8, Top 4% (SCI Q1)
    CiteScore: 17.6, Top 3% (Q1)
    Google Scholar h5-index: 77, TOP 5
Turn off MathJax
Article Contents
Adedapo Odekunle, Weinan Gao and Yebin Wang, "Data-Driven Global Robust Optimal Output Regulation of Uncertain Partially Linear Systems," IEEE/CAA J. Autom. Sinica, vol. 6, no. 5, pp. 1108-1115, Sept. 2019. doi: 10.1109/JAS.2019.1911678
Citation: Adedapo Odekunle, Weinan Gao and Yebin Wang, "Data-Driven Global Robust Optimal Output Regulation of Uncertain Partially Linear Systems," IEEE/CAA J. Autom. Sinica, vol. 6, no. 5, pp. 1108-1115, Sept. 2019. doi: 10.1109/JAS.2019.1911678

Data-Driven Global Robust Optimal Output Regulation of Uncertain Partially Linear Systems

doi: 10.1109/JAS.2019.1911678
More Information
  • In this paper, a data-driven control approach is developed by reinforcement learning (RL) to solve the global robust optimal output regulation problem (GROORP) of partially linear systems with both static uncertainties and nonlinear dynamic uncertainties. By developing a proper feedforward controller, the GROORP is converted into a global robust optimal stabilization problem. A robust optimal feedback controller is designed which is able to stabilize the system in the presence of dynamic uncertainties. The closed-loop system is ensured to be input-to-output stable regarding the static uncertainty as the external input. This robust optimal controller is numerically approximated via RL. Nonlinear small-gain theory is applied to show the input-to-output stability for the closed-loop system and thus solves the original GROORP. Simulation results validates the efficacy of the proposed methodology.

     

  • loading
  • [1]
    B. Francis, " The linear multivariable regulator problem,” SIAM Journal on Control and Optimization, vol. 15, no. 3, pp. 486–505, 1977. doi: 10.1137/0315033
    [2]
    A. Isidori and C. I. Byrnes, " Output regulation of nonlinear systems,” IEEE Transactions on Automatic Control, vol. 35, no. 2, pp. 131–140, Feb. 1990. doi: 10.1109/9.45168
    [3]
    J. Huang and W. J. Rugh, " On a nonlinear multivariable servomechanism problem,” Automatica, vol. 26, no. 6, pp. 963–972, 1990. doi: 10.1016/0005-1098(90)90081-R
    [4]
    C. I. Byrnes, F. D. Priscoli, A. Isidori, and W. Kang, " Structurally stable output regulation of nonlinear systems,” Automatica, vol. 33, no. 3, pp. 369–385, 1997. doi: 10.1016/S0005-1098(96)00184-7
    [5]
    A. Serrani, A. Isidori, and L. Marconi, " Semiglobal nonlinear output regulation with adaptive internal model,” IEEE Transactions on Automatic Control, vol. 46, no. 8, pp. 1178–1194, 2001. doi: 10.1109/9.940923
    [6]
    J. Huang, Nonlinear Output Regulation: Theory and Applications. Philadelphia, PA: SIAM, 2004.
    [7]
    F. A. Yaghmaie, K. H. Movric, F. L. Lewis, R. Su, and M. Sebek, " H output regulation of linear heterogeneous multiagent systems over switching graphs,” Interational Journal of Robust and Nonlinear Control, vol. 28, pp. 3852–3870, 2018. doi: 10.1002/rnc.v28.13
    [8]
    T. Başar and P. Bernhard, H optimal control and related minimax design problems: a dynamic game approach. Springer Science & Business Media, 2008.
    [9]
    T. Liu, D. J. Hill, and Z. P. Jiang, " Lyapunov formulation of ISS cyclicsmall-gain in continuous-time dynamical networks,” Automatica, vol. 47, no. 9, pp. 2088–2093, 2011. doi: 10.1016/j.automatica.2011.06.018
    [10]
    T. Liu and Z. Jiang, " A small-gain approach to robust event-triggered control of nonlinear systems,” IEEE Transactions on Automatic Control, vol. 60, no. 8, pp. 2072–2085, 2015. doi: 10.1109/TAC.2015.2396645
    [11]
    J. Huang and Z. Chen, " A general framework for tackling the output regulation problem,” IEEE Transactions on Automatic Control, vol. 49, no. 12, pp. 2203–2218, 2004. doi: 10.1109/TAC.2004.839236
    [12]
    F. L. Lewis and D. Vrabie, " Reinforcement learning and adaptive dynamic programming for feedback control,” IEEE Circuits and Systems Magazine, vol. 9, no. 3, pp. 32–50, 2009. doi: 10.1109/MCAS.2009.933854
    [13]
    Y. Jiang and Z. P. Jiang, " Computational adaptive optimal control for continuous-time linear systems with completely unknown dynamics,” Automatica, vol. 48, no. 10, pp. 2699–2704, 2012. doi: 10.1016/j.automatica.2012.06.096
    [14]
    W. Gao, Y. Jiang, Z. P. Jiang, and T. Chai, " Adaptive and optimal output feedback control of linear systems: an adaptive dynamic programming approach,” in Proc. of the 11th World Congr. on Intelligent Control and Automation, Shenyang, China, 2014, pp. 2085–2090.
    [15]
    W. Gao, Z. P. Jiang, and K. Ozbay, " Adaptive optimal control of connected vehicles,” in Proc. of the 10th Int. Workshop on Robot Motion and Control, Poznan, Poland, 2015, pp. 288–293.
    [16]
    W. Gao and Z. P. Jiang, " Global optimal output regulation of partially linear systems via robust adaptive dynamic programming,” in Proc. 1st Conf. on Modelling. Identification and Control of Nonlinear Systems, vol. 48, no. 11, Saint-Petersburg, Russia, 2015, pp. 742–747.
    [17]
    B. Sun, M. He, Y. Wang, W. Gui, C. Yang, and Q. Zhu, " A data-driven optimal control approach for solution purification process,” Journal of Process Control, vol. 68, pp. 171–185, 2018. doi: 10.1016/j.jprocont.2018.06.005
    [18]
    Y. Jiang and Z. P. Jiang, " Robust adaptive dynamic programming and feedback stabilization of nonlinear systems,” IEEE Transactions on Neural Networks and Learning Systems, vol. 25, no. 5, pp. 882–893, 2014. doi: 10.1109/TNNLS.2013.2294968
    [19]
    W. Gao and Z. P. Jiang, " Linear optimal tracking control: an adaptive dynamic programming approach,” in Proc. of the American Control Conf., Chicago, IL, 2015, pp. 4929–4934.
    [20]
    A. J. Krener, " The construction of optimal linear and nonlinear regulators,” in Systems, Models and Feedback: Theory and Applications, A. Isidori and T. J. Tarn, Eds. Birkhauser Boston, 1992, vol. 12, pp. 301–322.
    [21]
    W. Gao and Z. P. Jiang, " Adaptive dynamic programming and adaptive optimal output regulation of linear systems,” IEEE Transactions on Automatic Control, vol. 61, no. 12, pp. 4164–4169, 2016. doi: 10.1109/TAC.2016.2548662
    [22]
    H. Modares, F. L. Lewis, and Z. Jiang, " H tracking control of completely unknown continuous-time systems via off-policy reinforcement learning,” IEEE Transactions on Neural Networks and Learning Systems, vol. 26, no. 10, pp. 2550–2562, 2015. doi: 10.1109/TNNLS.2015.2441749
    [23]
    A. Saberi, P. Kokotovic, and S. Summers, " Global stabilization of partially linear composite systems,” SIAM Journal of Control and Optimization, vol. 2, no. 6, pp. 1491–1503, 1990.
    [24]
    Z. P. Jiang, A. R. Teel, and L. Praly, " Small-Gain theorem for ISS systems and applications,” Mathematics of Control,Signals and Systems, vol. 7, no. 2, pp. 95–120, 1994. doi: 10.1007/BF01211469
    [25]
    E. D. Sontag, " Input to state stability: basic concepts and results,” in Nonlinear and Optimal Control Theory, P. Nistri and G. Stefani, Eds. Berlin: Springer-Verlag, 2007, pp. 163–220.
    [26]
    E. D. Sontag, " Smooth stabilization implies coprime factorization,” IEEE Transactions on Automatic Control, vol. 34, no. 4, pp. 435–443, 1989. doi: 10.1109/9.28018

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(8)

    Article Metrics

    Article views (2103) PDF downloads(94) Cited by()

    Highlights

    • A novel data-driven control approach is proposed to solve global robust optimal regulation problems.
    • Considering the presence Both static and dynamic uncertainties in the partially linear systems, a robust optimal controller is developed in terms of reinforcement learning and small gain theory.
    • It is rigorously ensured that the system in closedloop with the developed controller is robust to the uncertainties.

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return