Analysis of structured multi-dimensional Markov processes