雙時間尺度的馬爾可夫系統的應用：英文

Preface
1 Introduction
1.1 Two-time-scale Markovian Systems
1.2 Literature Review
1.3 Why Do We Need This Book?
1.4 Outline of the Book
Part I Asymptotic Results: Two-time-scale Markov Chains

2 Summary of Two-time-scale Markov Chains: Finite State Space
Cases
2.1 Two-time-scale Continuous-time Markov Chains
2.2Properties of Two-time-scale Markov Chains
2.2.1 Asymptotic Expansions
2.2.2 Occupation Measures
2.2.3 Exponential Bounds
2.3 Ramifications
2.4 Notes

3 Switching Diffusion Limits
3.1 Introduction
3.2Problem Formulation and Preliminaries
3.2.1 Formulation
3.2.2 Conditions
3.2.3Preliminaries
3.3 Asymptotic Properties
3.3.1 A Mean Square Estimate
3.3.2 Weak Convergence of the Aggregated Process
3.4 Inclusion of Transient States in the Jump Process
3.5 Notes

4 Countable State Space h Single-Group Recurrent States
4.1 Introduction
4.2 Formulation
4.2.1 Basic Notation
4.2.2 Two-time-scale Markov Chains
4.3 Asymptotic Expansions
4.3.1 Formal Expansions
4.3.2 Asymptotic Justification
4.3.3 Asymptotic Expansion of Transition Probability Matrices
4.4 Occupation Measures
4.4.1 Second Moment Bounds and Mixing Property
4.4.2 Functionals of the Two-time-scale Markov Chain
4.4.3 Invariance Theorem and Limit Distribution
4.5 Applications to Queueing Processes
4.6 Notes

Countable State Space II: Multi-Group Recurrent States
5.1 Introduction
5.2 Formulation
5.2.1 Notation
5.2.2 Queue Length and Two-time-scale Markov Chains
5.3 Asymptotic Properties of Probability Distribution
5.3.1 Formal Expansions
5.3.2 Asymptotic Justification
5.3.3 Asymptotic Expansion of Transition Probability Matrices
5.4 Aggregation and Weak Convergence
5.5 Switching Diffusion Limit
5.6 An Example
5.7 Notes

Part II Several Application Examples to Financial Engineering,
Insurance, Neueing Networks, and Filtering
Financial Engineering
6.1 Geometric Brownian Motion Model
6.2 Stock Selling Rule
6.2.1 Two-point Boundary Value Problems
6.2.2 Limit Problem and Near Optimality
6.2.3 Expected Exit Time and Related Probabilities
6.2.4 Numerical Examples
6.3 Near-optimal Asset Allocation
6.3.1 Optimal Asset Allocation
6.3.2 Convergence of Value Functions
6.3.3 Near-optimal Asset Allocation
6.4 Notes

7 Near-Optimal Dividend Policy
7.1 Formulation
7.2 Limit Problem
7.3 Convergence of the Cost and Value Functions
7.4 Near-Optimal Dividend Policy
7.5 Notes

8 Queueing Networks
8.1 Application to Mt/Mt/1/rn
8.2 Markovian Queueing Networks
8.3 Markov-Modulated-Rate Fluid Models
8.4 Notes

9 Wonham Filtering
9.1 Introduction
9.1.1 Wonham Filtering
9.2 Two-time scale Markov Chains
9.2.1 Two-time-scale Filters
9.3 Limit Filter and Two-Time-Scale Approximation
9.3.1 Limit Filter
9.3.2 Two-time-scale Approximation
9.4 A Numerical Example
9.5 Inclusion of Transient States
9.6 Notes
A Background Materials
References
Index