Toward data-driven solutions to interactive dynamic influence diagrams

Yinghui Pan, Jing Tang, Biyang Ma, Yifeng Zeng*, Zhong Ming

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

With the availability of significant amount of data, data-driven decision making becomes an alternative way for solving complex multiagent decision problems. Instead of using domain knowledge to explicitly build decision models, the data driven approach learns decisions (probably optimal ones) from available data. This removes the knowledge bottleneck in the traditional knowledge-driven decision making, which requires a strong support from domain experts. In this paper, we study data-driven decision making in the context of interactive dynamic influence diagrams (I-DIDs) - a general framework for multiagent sequential decision making under uncertainty. We propose a data-driven framework to solve the I-DIDs model and focus on learning the behavior of other agents in problem domains. The challenge is on learning a complete policy tree that will be embedded in the I-DIDs models due to limited data. We propose two new methods to develop complete policy trees for the other agents in the I DIDs. The first method uses a simple clustering process while the second one employs sophisticated statistical checks. We analyze the proposed algorithms in a theoretical way and experiment them over two problem domains.
Original languageEnglish
Pages (from-to)2431–2453
Number of pages23
JournalKnowledge and Information Systems
Volume63
Issue number9
Early online date8 Aug 2021
DOIs
Publication statusPublished - 1 Sep 2021

Fingerprint

Dive into the research topics of 'Toward data-driven solutions to interactive dynamic influence diagrams'. Together they form a unique fingerprint.

Cite this