markov_model function

Markov model for the online attribution problem.