Stochastic Processes

Markov Processes - Home
Exercises: 1 - 2 - 3 - 4 - 5 - 6 - 7 - 8 - 9 - 10 - 11 - 12 - 13 - 14 - 15 - 16 - 17 - 18 - 19 - 20 - 21 - 22 - 23 - 24 - 25 - 26 - 27 - 28 - 29 - 30 - 31 - 32 - 33 - 34 - 35 - 36 - 37 - 38 - 39 - 40 - 41 - 42 - 43 - 44 - 45 - 46 - 47 - 48 - 49 - 50 - 51 - 52 - 53 - 54 - 55 - 56 - 57 - 58 - 59 - 60 - 61

Exercise. Argue that the number of neutrons in a molecular reactor is a Markov process.

Solution. The number of neutrons at any future time depends only on the number of neutrons available at an immediately previous time (i.e., before a single reaction event occurred). Hence there is no memory in the number of neutrons and the process is Markovian.