A hybrid POMDP-BDI agent architecture with online stochastic planning and plan caching

Rens, G and Moodley, D (2017) A hybrid POMDP-BDI agent architecture with online stochastic planning and plan caching, Cognitive Systems Research, 43, 1-20, Elsevier B.V..

[img] PDF
cog-sys-res-rens-moodley2017.pdf

Download (647kB)

Abstract

This article presents an agent architecture for controlling an autonomous agent in stochastic, noisy environments. The architecture combines the partially observable Markov decision process (POMDP) model with the belief-desire-intention (BDI) framework. The Hybrid POMDP-BDI agent architecture takes the best features from the two approaches, that is, the online generation of reward-maximizing courses of action from POMDP theory, and sophisticated multiple goal management from BDI theory. We introduce the advances made since the introduction of the basic architecture, including (i) the ability to pursue and manage multiple goals simultaneously and (ii) a plan library for storing pre-written plans and for storing recently generated plans for future reuse. A version of the architecture is implemented and is evaluated in a simulated environment. The results of the experiments show that the improved hybrid architecture outperforms the standard POMDP architecture and the previous basic hybrid architecture for both processing speed and effectiveness of the agent in reaching its goals.

Item Type: Journal article (paginated)
Subjects: Computing methodologies > Artificial intelligence
Alternate Locations: http://www.sciencedirect.com/science/article/pii/S1389041716300870?via%3Dihub
Date Deposited: 23 Nov 2017
Last Modified: 10 Oct 2019 15:31
URI: http://pubs.cs.uct.ac.za/id/eprint/1218

Actions (login required)

View Item View Item