Infinite Horizon Markov Economies

The paper introduces Markov pseudo-games, a framework generalizing both Markov games and pseudo-games to capture time, uncertainty, and action-dependent feasibility sets. It proves equilibrium existence and provides a polynomial-time solution method. Within the taxonomy, the work resides in 'Markov Exchange Economy Computation,' a leaf containing only three papers. This is a relatively sparse research direction within the broader field of fifty papers, suggesting the specific combination of Markovian structure, pseudo-game formulation, and computational tractability remains underexplored.

The taxonomy reveals that neighboring leaves address related but distinct challenges. 'OLG and Finite Horizon Computation' focuses on overlapping generations and finite-dimensional settings, while 'Stationary Markov Equilibrium Computation' emphasizes game-theoretic methods without the exchange economy context. The 'Existence and Characterization of Equilibria' branch provides theoretical foundations for incomplete markets and debt constraints, but excludes computational methods. The paper bridges these areas by combining game-theoretic equilibrium computation with infinite-horizon exchange economy models, positioning itself at the intersection of strategic interaction and economic equilibrium.

Among twenty-one candidates examined, none clearly refute the three main contributions. The Markov pseudo-games framework examined ten candidates with zero refutations, the reformulation of recursive Radner equilibria examined six with zero refutations, and the generative adversarial policy network examined five with zero refutations. This limited search scope—top-K semantic matches plus citation expansion—suggests that within the examined literature, the specific combination of pseudo-game formulation, polynomial-time convergence guarantees, and application to infinite-horizon Markov exchange economies appears novel. However, the small candidate pool means broader prior work may exist outside this search.

Given the sparse taxonomy leaf and absence of refutations among examined candidates, the work appears to occupy a relatively unexplored niche. The analysis covers a focused subset of the literature rather than an exhaustive survey, so definitive claims about absolute novelty remain premature. The contribution's distinctiveness likely stems from integrating game-theoretic pseudo-games with economic equilibrium computation, a combination not prominently represented in the examined papers.