Jane Street Interview Question

probability question, and markov chain