Value function iterations with transition matrix

We consider the following case with transition matrix

where

that is the same as yesterday’s. Today we set aggregate model with

where both A and Q change according to transition matrix.

If the transition matrix is m x m, then there are m sets of different A and Q.