skip to main content
Idioma:

On Convex Optimal Value Functions For POSGs

Cunha, Rafael F ; Castellini, Jacopo ; Peralez, Johan ; Dibangoye, Jilles S

arXiv.org, 2023-12

Ithaca: Cornell University Library, arXiv.org

Texto completo disponível

Citações Citado por
  • Título:
    On Convex Optimal Value Functions For POSGs
  • Autor: Cunha, Rafael F ; Castellini, Jacopo ; Peralez, Johan ; Dibangoye, Jilles S
  • Assuntos: Algorithms ; Computer Science - Multiagent Systems ; Conditional probability ; Game theory ; Games ; Machine learning ; Multiagent systems ; Trusted third parties
  • É parte de: arXiv.org, 2023-12
  • Descrição: Multi-agent planning and reinforcement learning can be challenging when agents cannot see the state of the world or communicate with each other due to communication costs, latency, or noise. Partially Observable Stochastic Games (POSGs) provide a mathematical framework for modelling such scenarios. This paper aims to improve the efficiency of planning and reinforcement learning algorithms for POSGs by identifying the underlying structure of optimal state-value functions. The approach involves reformulating the original game from the perspective of a trusted third party who plans on behalf of the agents simultaneously. From this viewpoint, the original POSGs can be viewed as Markov games where states are occupancy states, \ie posterior probability distributions over the hidden states of the world and the stream of actions and observations that agents have experienced so far. This study mainly proves that the optimal state-value function is a convex function of occupancy states expressed on an appropriate basis in all zero-sum, common-payoff, and Stackelberg POSGs.
  • Editor: Ithaca: Cornell University Library, arXiv.org
  • Idioma: Inglês
Links
Voltar para lista de resultados

  • Realização: ABCD-USP USP   Logos de Redes Sociais: Freepik

Buscando em bases de dados remotas. Favor aguardar.