- IB
- AHL 4.19—Transition matrices – Markov chains
Practice AHL 4.19—Transition matrices – Markov chains with authentic IB Mathematics Applications & Interpretation (AI) exam questions for both SL and HL students. This question bank mirrors Paper 1, 2, 3 structure, covering key topics like core principles, advanced applications, and practical problem-solving. Get instant solutions, detailed explanations, and build exam confidence with questions in the style of IB examiners.
A network of paths connects four nodes, A, B, C, and D, as shown:

Dashed lines indicate paths that are twice as likely to be chosen.
Construct the transition matrix for a particle moving between the nodes.
Find the steady-state probability distribution using a graphic display calculator.
Explain one limitation of this model in the context of path selection.
A system transitions between states , and with transition matrix:
Find an eigenvector corresponding to the eigenvalue .
Using Part 1, determine the long-term probability of being in state .
A zoo has three habitats, H, I, and J, connected as shown in the diagram below:

An animal moves between habitats with equal probability for each available path from its current habitat.
Write down the transition matrix, , for this system.
If the animal starts in habitat H, find the probability it is in habitat J after two moves.
Find the long-term probability of the animal being in habitat I.
A Markov chain models a process with states , and , with transition matrix:
Verify that is a valid transition matrix.
Express as , finding matrices and .
John likes to go sailing every day in July. To help him make a decision on whether it is safe to go sailing he classifies each day in July as windy or calm. Given that a day in July is calm, the probability that the next day is calm is $0.9$. Given that a day in July is windy, the probability that the next day is calm is $0.3$. The weather forecast for the 1st July predicts that the probability that it will be calm is $0.8$.
Draw a tree diagram to represent this information for the first three days of July.
Find the probability that the 3rd July is calm.
Find the probability that the 1st July was calm given that the 3rd July is windy.
A game involves a player moving between states , and , with transitions shown in the following diagram:

The player moves with equal probability to each connected state.
Write down the transition matrix for this game.
Find the steady-state probability vector .
Find the minimum number of moves for the player to be at least certain of reaching state , starting from state .
A wildlife reserve is tracking the movement of a certain species of bird between three regions: Region X, Region Y, and Region Z. Each month, 20% of the birds in Region X move to Region Y, 10% move to Region Z, 15% of the birds in Region Y move to Region X, 5% move to Region Z, 25% of the birds in Region Z move to Region X, and 10% move to Region Y.
Construct the transition matrix for the movement of birds between the three regions.
If initially there are 100 birds in Region X, 150 in Region Y, and 200 in Region Z, calculate the distribution of birds after one month.
Draw the transition diagram representing the movement of birds between the three regions.
A biologist models animal migration between three regions, , and . The transitions are represented in the following diagram, where dashed lines represent paths that are twice as likely as solid lines originating from the same region.

Construct the transition matrix for this model.
Find the steady-state distribution for the animal's location.
If the animal starts at region , find the probability it is at region after exactly two moves.
A robot navigates a system with four states , connected as follows:

The robot moves with equal probability to each connected state.
State the transition matrix for this system.
Find the probability of being in state after four transitions, starting from state .
Determine the expected number of steps for the robot to return to state for the first time, starting from state .
A company has two warehouses, Warehouse X and Warehouse Y. Goods can be transferred between the warehouses or remain in the same warehouse. The transition matrix below shows the probabilities of goods being transferred or staying in the same warehouse.
Given the transition matrix: Draw the transition diagram representing the probabilities of goods being transferred between Warehouse X and Warehouse Y.
If initially 70% of the goods are in Warehouse X and 30% in Warehouse Y, calculate the distribution of goods after one transfer cycle.
Practice AHL 4.19—Transition matrices – Markov chains with authentic IB Mathematics Applications & Interpretation (AI) exam questions for both SL and HL students. This question bank mirrors Paper 1, 2, 3 structure, covering key topics like core principles, advanced applications, and practical problem-solving. Get instant solutions, detailed explanations, and build exam confidence with questions in the style of IB examiners.
A network of paths connects four nodes, A, B, C, and D, as shown:

Dashed lines indicate paths that are twice as likely to be chosen.
Construct the transition matrix for a particle moving between the nodes.
Find the steady-state probability distribution using a graphic display calculator.
Explain one limitation of this model in the context of path selection.
A system transitions between states , and with transition matrix:
Find an eigenvector corresponding to the eigenvalue .
Using Part 1, determine the long-term probability of being in state .
A zoo has three habitats, H, I, and J, connected as shown in the diagram below:

An animal moves between habitats with equal probability for each available path from its current habitat.
Write down the transition matrix, , for this system.
If the animal starts in habitat H, find the probability it is in habitat J after two moves.
Find the long-term probability of the animal being in habitat I.
A Markov chain models a process with states , and , with transition matrix:
Verify that is a valid transition matrix.
Express as , finding matrices and .
John likes to go sailing every day in July. To help him make a decision on whether it is safe to go sailing he classifies each day in July as windy or calm. Given that a day in July is calm, the probability that the next day is calm is $0.9$. Given that a day in July is windy, the probability that the next day is calm is $0.3$. The weather forecast for the 1st July predicts that the probability that it will be calm is $0.8$.
Draw a tree diagram to represent this information for the first three days of July.
Find the probability that the 3rd July is calm.
Find the probability that the 1st July was calm given that the 3rd July is windy.
A game involves a player moving between states , and , with transitions shown in the following diagram:

The player moves with equal probability to each connected state.
Write down the transition matrix for this game.
Find the steady-state probability vector .
Find the minimum number of moves for the player to be at least certain of reaching state , starting from state .
A wildlife reserve is tracking the movement of a certain species of bird between three regions: Region X, Region Y, and Region Z. Each month, 20% of the birds in Region X move to Region Y, 10% move to Region Z, 15% of the birds in Region Y move to Region X, 5% move to Region Z, 25% of the birds in Region Z move to Region X, and 10% move to Region Y.
Construct the transition matrix for the movement of birds between the three regions.
If initially there are 100 birds in Region X, 150 in Region Y, and 200 in Region Z, calculate the distribution of birds after one month.
Draw the transition diagram representing the movement of birds between the three regions.
A biologist models animal migration between three regions, , and . The transitions are represented in the following diagram, where dashed lines represent paths that are twice as likely as solid lines originating from the same region.

Construct the transition matrix for this model.
Find the steady-state distribution for the animal's location.
If the animal starts at region , find the probability it is at region after exactly two moves.
A robot navigates a system with four states , connected as follows:

The robot moves with equal probability to each connected state.
State the transition matrix for this system.
Find the probability of being in state after four transitions, starting from state .
Determine the expected number of steps for the robot to return to state for the first time, starting from state .
A company has two warehouses, Warehouse X and Warehouse Y. Goods can be transferred between the warehouses or remain in the same warehouse. The transition matrix below shows the probabilities of goods being transferred or staying in the same warehouse.
Given the transition matrix: Draw the transition diagram representing the probabilities of goods being transferred between Warehouse X and Warehouse Y.
If initially 70% of the goods are in Warehouse X and 30% in Warehouse Y, calculate the distribution of goods after one transfer cycle.