Elements of Stochastic Modelling

Download or read book Elements of Stochastic Modelling written by K. A. Borovkov and published by World Scientific. This book was released on 2003 with total page 360 pages. Available in PDF, EPUB and Kindle. Book excerpt: This textbook has been developed from the lecture notes for a one-semester course on stochastic modelling. It reviews the basics of probability theory and then covers the following topics: Markov chains, Markov decision processes, jump Markov processes, elements of queueing theory, basic renewal theory, elements of time series and simulation. Rigorous proofs are often replaced with sketches of arguments ? with indications as to why a particular result holds, and also how it is connected with other results ? and illustrated by examples. Wherever possible, the book includes references to more specialised texts containing both proofs and more advanced material related to the topics covered.