skip to main content

Learning to Make Predictions In Partially Observable Environments Without a Generative Model

Talvitie, E ; Singh, S

The Journal of artificial intelligence research, 2011-01, Vol.42, p.353 [Periódico revisado por pares]

San Francisco: AI Access Foundation

Texto completo disponível

Citações Citado por
  • Título:
    Learning to Make Predictions In Partially Observable Environments Without a Generative Model
  • Autor: Talvitie, E ; Singh, S
  • Assuntos: Artificial intelligence ; Learning
  • É parte de: The Journal of artificial intelligence research, 2011-01, Vol.42, p.353
  • Descrição: When faced with the problem of learning a model of a high-dimensional environment, a common approach is to limit the model to make only a restricted set of predictions, thereby simplifying the learning problem. These partial models may be directly useful for making decisions or may be combined together to form a more complete, structured model. However, in partially observable (non-Markov) environments, standard model-learning methods learn generative models, i.e. models that provide a probability distribution over all possible futures (such as POMDPs). It is not straightforward to restrict such models to make only certain predictions, and doing so does not always simplify the learning problem. In this paper we present prediction profile models: non-generative partial models for partially observable systems that make only a given set of predictions, and are therefore far simpler than generative models in some cases. We formalize the problem of learning a prediction profile model as a transformation of the original model-learning problem, and show empirically that one can learn prediction profile models that make a small set of important predictions even in systems that are too complex for standard generative models.
  • Editor: San Francisco: AI Access Foundation
  • Idioma: Inglês

Buscando em bases de dados remotas. Favor aguardar.