MATH 357H COURSE SYLLABUS

# Math 357H: Introduction to Stochastic Processes

## Fall 2007

Instructor: Michelle Boué
Email:
Office Phone:748-1011 x7925
Office hours:
 Monday 12-1 Tuesday 11-12 Friday 10-11
Office: Peter Gzowski College 332
 Secretary: Carolyn Johns Email: math@trentu.ca or cjohns@trentu.ca Office Phone: 748-1011 x7531 Fax: 748-1155 Office: Peter Gzowski College 341

### COURSE  TOPICS

The goal of this course is to present a variety of important models used in modeling of random events that evolve in time. These include Markov chains (both discrete and continuous), Poisson processes and queues. We will illustrate through different examples the rich diversity of applications of the subject. Topics marked with (*) are optional; a selection of these could be covered depending on the specific interests of the students.

### TEXT

Introduction to Probability Models, by Sheldon M. Ross (Academic Press, 8th edition).

### COURSE OUTLINE

1. Introduction to Stochastic Processes
1. Definition
2. State space and parameter space
3. Examples
2. Conditional Probability and Conditional Expectation
1. Generalization of conditional probability to random variables
2. Computing expectations by conditioning
3. Computing probabilities by conditioning
3. Discrete Time Markov Chains
1. Definition and examples
2. Chapman-Kolmogorov equations
3. Transience and recurrence
4. Stationary distributions
5. Sequential decisions and Markov chains (*)
6. Simulations and Markov Chain Monte Carlo (*)
4. The Poisson Process
1. Axiomatic definition
2. Waiting time distributions
3. Generalizations
4. Simulation (*)
5. Continuous Time Markov Chains
1. Definition
2. Birth and death processes
3. Transition probabilities; Chapman-Kolmogorov Equations
6. Queues
1. Definitions and basic structure of a queueing system
2. M/M/1, M/M/m, M/G/1 and M/M/m models
3. Applications

### STUDENT  BACKGROUND

Mathematics: This course requires Calculus (MATH 105 or MATH 110), Linear Algebra (MATH 135H) and a strong background in Probability (MATH 155H).

### PROBLEM SET POLICY

Problem sets will be posted on MyLearningSystem, with a notification of due date and time. Problem set solutions are to be submitted in class or by the due time in the instructor's drop box on the day they are due. No late submissions are accepted since solutions to assignments will be posted at deadline time.

### MIDTERM EXAMINATION

There will be one midterm examination on Tuesday, October 30.

### OTHER IMPORTANT DATES

October 22-26 is Reading Week.   Last day of classes is Friday, December 7.

### COURSE EVALUATION

 Problem sets: 4 x 10% 40% Midterm exam 1 x 20% 20% Project 1 x 15% 15% Final exam 1 x 25% 25% 100%