Markov decision processes (MDPs), also called stochastic dynamic programming, were first studied in the 1960s. MDPs can be used to model and solve dynamic decision-making problems that are multi-period and occur in stochastic circumstances. There are three basic branches in MDPs: discrete-time MDPs, continuous-time MDPs and semi-Markov decision processes. Starting from these three branches, many generalized MDPs models have been applied to various practical problems. These models include partially observable MDPs, adaptive MDPs, MDPs in stochastic environments, and MDPs with multiple objectives, constraints or imprecise parameters.
Markov Decision Processes With Their Applications examines MDPs and their applications in the optimal control of discrete event systems (DESs), optimal replacement, and optimal allocations in sequential online auctions. The book presents four main topics that are used to study optimal control problems: a new methodology for MDPs with discounted total reward criterion; transformation of continuous-time MDPs and semi-Markov decision processes into a discrete-time MDPs model, thereby simplifying the application of MDPs; MDPs in stochastic environments, which greatly extends the area where MDPs can be applied; applications of MDPs in optimal control of discrete event systems, optimal replacement, and optimal allocation in sequential online auctions.
This book is intended for researchers, mathematicians, advanced graduate students, and engineers who are interested in optimal control, operation research, communications, manufacturing, economics, and electronic commerce.
Die Inhaltsangabe kann sich auf eine andere Ausgabe dieses Titels beziehen.
SHUNFU JIN holds a B.Eng. degree in Computer and Application from North East Heavy Machinery College, Qiqihaer, China, and an M.Eng. degree in Computer Science and Dr.Eng. degree in Circuit and System from Yanshan University, Qinhuangdao, China. She is currently a Professor at the School of Information Science and Engineering, Yanshan University, China. Her research interests include resource management in communication networks, stochastic modelling and performance evaluation for computer networks and telecommunications. Dr. Jin's papers have been published in journals such as Telecommunication Systems, Computer Networks, Performance Evaluation, Journal of Industrial & Management Optimization, Journal of Global Optimization, and Journal of Communications & Networks. WUYI YUE holds a B.Eng. degree in Electronic Engineering from Tsinghua University, China, and M.Eng. and Dr.Eng. degrees in Applied Mathematics and Physics from Kyoto University,Japan. She is currently a Professor at the Department of Intelligence and Informatics, Konan University, Japan, a fellow of the Operations Research Society of Japan, a senior member of IEICE, and a member of IEEE. Dr. Yue has served as chair (or co-chair) and member of several international conferences and symposia and is on the editorial board of many international journals. Dr. Yue's research interests include queueing theory, performance analysis and evaluation, and resource allocation of telecommunication networks.
Markov decision processes (MDPs), also called stochastic dynamic programming, were first studied in the 1960s. MDPs can be used to model and solve dynamic decision-making problems that are multi-period and occur in stochastic circumstances. There are three basic branches in MDPs: discrete-time MDPs, continuous-time MDPs and semi-Markov decision processes. Starting from these three branches, many generalized MDPs models have been applied to various practical problems. These models include partially observable MDPs, adaptive MDPs, MDPs in stochastic environments, and MDPs with multiple objectives, constraints or imprecise parameters.
Markov Decision Processes With Their Applications examines MDPs and their applications in the optimal control of discrete event systems (DESs), optimal replacement, and optimal allocations in sequential online auctions. The book presents four main topics that are used to study optimal control problems:
*a new methodology for MDPs with discounted total reward criterion;
*transformation of continuous-time MDPs and semi-Markov decision processes into a discrete-time MDPs model, thereby simplifying the application of MDPs;
*MDPs in stochastic environments, which greatly extends the area where MDPs can be applied;
*applications of MDPs in optimal control of discrete event systems, optimal replacement, and optimal allocation in sequential online auctions.
This book is intended for researchers, mathematicians, advanced graduate students, and engineers who are interested in optimal control, operation research, communications, manufacturing, economics, and electronic commerce.
„Über diesen Titel“ kann sich auf eine andere Ausgabe dieses Titels beziehen.
Ihre gesetzlichen Garantierechte: Alle Verbraucher:innen in der EU profitieren von mindestens 2 Jahren gesetzlichem Garantieschutz für alle in der EU verkauften Konsumgüter. Mehr erfahren
Anbieter: Romtrade Corp., STERLING HEIGHTS, MI, USA
Zustand: New. This is a Brand-new US Edition. This Item may be shipped from US or any other country as we have multiple locations worldwide. Artikel-Nr. ABBB-157873
Anbieter: Majestic Books, Hounslow, Vereinigtes Königreich
Zustand: Used. pp. 316 52:B&W 6.14 x 9.21in or 234 x 156mm (Royal 8vo) Case Laminate on White w/Gloss Lam. Artikel-Nr. 7397006
Anzahl: 1 verfügbar
Anbieter: Biblios, Frankfurt am main, HESSE, Deutschland
Zustand: Used. pp. 316. Artikel-Nr. 18483675
Anzahl: 1 verfügbar
Anbieter: Ria Christie Collections, Uxbridge, Vereinigtes Königreich
Zustand: New. In English. Artikel-Nr. ria9780387369501_new
Anzahl: Mehr als 20 verfügbar
Anbieter: AHA-BUCH GmbH, Einbeck, Deutschland
Buch. Zustand: Neu. Druck auf Anfrage Neuware - Printed after ordering - MDPs have been applied in many areas, such as communications, signal processing, artificial intelligence, stochastic scheduling and manufacturing systems, discrete event systems, management and economies. This book examines MDPs and their applications in the optimal control of discrete event systems (DESs), optimal replacement, and optimal allocations in sequential online auctions. The book presents three main topics: a new methodology for MDPs with discounted total reward criterion; transformation of continuous-time MDPs and semi-Markov decision processes into a discrete-time MDPs model, thereby simplifying the application of MDPs; application of MDPs in stochastic environments, which greatly extends the area where MDPs can be applied. Each topic is used to study optimal control problems or other types of problems. Artikel-Nr. 9780387369501
Anzahl: 1 verfügbar