Skip to content

Commit

Permalink
add definition of accessible
Browse files Browse the repository at this point in the history
Update related to #463
  • Loading branch information
longye-tian committed Jun 17, 2024
1 parent a4936a6 commit 298e812
Showing 1 changed file with 2 additions and 7 deletions.
9 changes: 2 additions & 7 deletions lectures/markov_chains_II.md
Original file line number Diff line number Diff line change
Expand Up @@ -58,14 +58,9 @@ import numpy as np

To explain irreducibility, let's take $P$ to be a fixed stochastic matrix.

Two states $x$ and $y$ are said to **communicate** with each other if
there exist positive integers $j$ and $k$ such that
State $x$ is called **accessible** (or **reachable**) from state $y$ if $P^t(x,y)>0$ for some integer $t\ge 0$.

$$
P^j(x, y) > 0
\quad \text{and} \quad
P^k(y, x) > 0
$$
Two states, $x$ and $y$, are said to **communicate** if $x$ and $y$ are accessible from each other.

In view of our discussion {ref}`above <finite_mc_mstp>`, this means precisely
that
Expand Down

0 comments on commit 298e812

Please sign in to comment.