An Evolutionary Framework for Modelling Unknown Behaviours of Other Agents

Yinghui Pan, Biyang Ma, Yifeng Zeng*, Jing Tang, Buxin Zeng, Zhong Ming*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)
14 Downloads (Pure)

Abstract

Multiagent decision making becomes complicated when a subject agent interacts with other agents who could be either collaborative or competitive in their common environment. Generally the subject agent does not know what exact behaviours other agents will execute in the coming interactions. This occurs even when the agents are collaborative and cannot fully disclose their behaviours due to their privacy concerns. With the purpose of improving prediction of the true behaviours of other agents, conventional approaches often employ either an exhaust list or a guided search to expand the set of possible behaviours of other agents. In this article, we investigate an evolutionary approach guided by prior knowledge about other agents and develop a genetic algorithm based framework to modelling unknown behaviours, which may contain the true behaviours of other agents. We develop a new framework with a multi-population genetic algorithm in a general multiagent decision model - interactive dynamic influence diagrams, which represents how multiple agents optimise their interactive decisions from the viewpoint of individual agents. The new framework also provides an alternative way to solving the decision model. We demonstrate the performance of the proposed methods in two problem domains and provide empirical results in support.
Original languageEnglish
Pages (from-to)1276-1289
Number of pages14
JournalIEEE Transactions on Emerging Topics in Computational Intelligence
Volume7
Issue number4
Early online date26 Dec 2022
DOIs
Publication statusPublished - 1 Aug 2023

Cite this