On a mean reward from a common Markov replacement process
Let a finite alphabet Ω. We consider a sequence of letters from Ω generated by a discrete time semi-Markov process We derive the probability of a word occurrence in the sequence. We also obtain results for the mean and variance of the number of overlapping occurrences of a word in a finite discrete time semi-Markov sequence of letters under certain conditions.