Infinite Horizon Optimal Control: Deterministic and Stochastic Systems

This book presents a systematic account of the development of optimal control problems defined on an unbounded time interval - beginning primarily with the work of the early seventies to the present. The first five to six chapters provide an introduction to infinite horizon control theory and require only a minimal knowledge of mathematical control theory. The remainder of the book considers extensions of the previous chapters to a variety of control systems, including distributed parameter systems, stochastic control systems and hereditary systems. Throughout the book it is possible to distinguish three categories of research: the extension of the classical necessary conditions to various weaker types of optimality (eg, overtaking optimality); the discussion of various sufficient conditions and verification theorems for the various types of optimality and the discussion of existence theorems for the various types of optimality. The common link between these categories is the "turnpike property" and the notion of "reduction to finite costs". Once these properties are established for a given control system, it is possible to begin investigating the issues described in the above three categories. This monograph on economics, mathematics, systems engineering and operations research is intended for researchers.