UCT CS Research Document Archive

Hybrid POMDP-BDI: An Agent Architecture with Online Stochastic Planning and Desires with Changing Intensity Levels

Rens, Gavin and Tommie Meyer (2015) Hybrid POMDP-BDI: An Agent Architecture with Online Stochastic Planning and Desires with Changing Intensity Levels. In Loiseau, Stephane and Joaquim Filipe, Eds. Proceedings 7th International Conference on Agents and Artificial Intelligence (ICAART) , pages 5-14, Lisbon, Portugal.

Full text available as:
PDF - Requires Adobe Acrobat Reader or other PDF viewer.

Abstract

Partially observable Markov decision processes (POMDPs) and the belief-desire-intention (BDI) framework have several complimentary strengths. We propose an agent architecture which combines these two powerful approaches to capitalize on their strengths. Our architecture introduces the notion of intensity of the desire for a goal’s achievement. We also define an update rule for goals’ desire levels. When to select a new goal to focus on is also defined. To verify that the proposed architecture works, experiments were run with an agent based on the architecture, in a domain where multiple goals must continually be achieved. The results show that (i) while the agent is pursuing goals, it can concurrently perform rewarding actions not directly related to its goals, (ii) the trade-off between goals and preferences can be set effectively and (iii) goals and preferences can be satisfied even while dealing with stochastic actions and perceptions. We believe that the proposed architecture furthers the theory of high-level autonomous agent reasoning.

EPrint Type:Conference Paper
Subjects:I Computing Methodologies: I.2 ARTIFICIAL INTELLIGENCE
ID Code:1091
Deposited By:Meyer, Thomas
Deposited On:18 August 2016