Lifting DecPOMDPs for Nanoscale Systems -- A Work in Progress

Tanya Braun; Stefan Fischer; Florian Lau; Ralf Möller

Lifting DecPOMDPs for Nanoscale Systems -- A Work in Progress

Tanya Braun, Stefan Fischer, Florian Lau, Ralf Möller

Abstract

DNA-based nanonetworks have a wide range of promising use cases, especially in the field of medicine. With a large set of agents, a partially observable stochastic environment, and noisy observations, such nanoscale systems can be modelled as a decentralised, partially observable, Markov decision process (DecPOMDP). As the agent set is a dominating factor, this paper presents (i) lifted DecPOMDPs, partitioning the agent set into sets of indistinguishable agents, reducing the worst-case space required, and (ii) a nanoscale medical system as an application. Future work turns to solving and implementing lifted DecPOMDPs.

Original language	English
Publication status	Published - 18.10.2021

Research Areas and Centers

Centers: Center for Artificial Intelligence Luebeck (ZKIL)
Research Area: Intelligent Systems

DFG Research Classification Scheme

4.43-03 Security and Dependability, Operating, Communication and Distributed Systems

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

2110.09152v1

Cite this

@techreport{20a8c675f7134a53bac60a4b926ae1a6,

title = "Lifting DecPOMDPs for Nanoscale Systems -- A Work in Progress",

abstract = " DNA-based nanonetworks have a wide range of promising use cases, especially in the field of medicine. With a large set of agents, a partially observable stochastic environment, and noisy observations, such nanoscale systems can be modelled as a decentralised, partially observable, Markov decision process (DecPOMDP). As the agent set is a dominating factor, this paper presents (i) lifted DecPOMDPs, partitioning the agent set into sets of indistinguishable agents, reducing the worst-case space required, and (ii) a nanoscale medical system as an application. Future work turns to solving and implementing lifted DecPOMDPs. ",

author = "Tanya Braun and Stefan Fischer and Florian Lau and Ralf M{\"o}ller",

note = "Accepted at the Tenth International Workshop on Statistical Relational AI (StarAI-2021)",

year = "2021",

month = oct,

day = "18",

language = "English",

type = "WorkingPaper",

}

TY - UNPB

T1 - Lifting DecPOMDPs for Nanoscale Systems -- A Work in Progress

AU - Braun, Tanya

AU - Fischer, Stefan

AU - Lau, Florian

AU - Möller, Ralf

N1 - Accepted at the Tenth International Workshop on Statistical Relational AI (StarAI-2021)

PY - 2021/10/18

Y1 - 2021/10/18

N2 - DNA-based nanonetworks have a wide range of promising use cases, especially in the field of medicine. With a large set of agents, a partially observable stochastic environment, and noisy observations, such nanoscale systems can be modelled as a decentralised, partially observable, Markov decision process (DecPOMDP). As the agent set is a dominating factor, this paper presents (i) lifted DecPOMDPs, partitioning the agent set into sets of indistinguishable agents, reducing the worst-case space required, and (ii) a nanoscale medical system as an application. Future work turns to solving and implementing lifted DecPOMDPs.

AB - DNA-based nanonetworks have a wide range of promising use cases, especially in the field of medicine. With a large set of agents, a partially observable stochastic environment, and noisy observations, such nanoscale systems can be modelled as a decentralised, partially observable, Markov decision process (DecPOMDP). As the agent set is a dominating factor, this paper presents (i) lifted DecPOMDPs, partitioning the agent set into sets of indistinguishable agents, reducing the worst-case space required, and (ii) a nanoscale medical system as an application. Future work turns to solving and implementing lifted DecPOMDPs.

M3 - Preprint

BT - Lifting DecPOMDPs for Nanoscale Systems -- A Work in Progress

ER -

Lifting DecPOMDPs for Nanoscale Systems -- A Work in Progress

Abstract

Research Areas and Centers

DFG Research Classification Scheme

UN SDGs

Access to Document

Fingerprint

Cite this