You would do these with transition matrices.
a) You would use

, where

is your tansition matrix,

is the probability of the first step. It's important to note that as we're starting with 0,

is equal to 3.
Spoiler

(note that this can be done with fractions on your calculator to get an exact answer).
Therefore the probability they will drink coffee for the fourth drink of the day is 0.5408
b) With the steady-state, you no longer consider the initial probability as this is the long-term trend - essentially, what the probability converges towards as

grows (reaches infinity).
If your transition matrix is

, then the steady state for the event in the first row is

, and for the one in the second row
