Dynamic State Space Partitioning for Adaptive Simulation Algorithms

Helms, Tobias and Mentel, Steffen and Uhrmacher, Adelinde (2016) Dynamic State Space Partitioning for Adaptive Simulation Algorithms. Dynamic State Space Partitioning for Adaptive Simulation Algorithms, 2 (10). e2. ISSN 2312-8623

[thumbnail of eai.14-12-2015.2262710.pdf]
Available under License Creative Commons Attribution No Derivatives.

Download (187kB) | Preview


Adaptive simulation algorithms can automatically change their configuration during runtime to adapt to changing computational demands of a simulation, e.g., triggered by a changing number of model entities or the execution of a rare event. These algorithms can improve the performance of simulations. They can also reduce the configuration effort of the user. By using such algorithms with machine learning techniques, the advantages come with a cost, i.e., the algorithm needs time to learn good adaptation policies and it must be equipped with the ability to observe its environment. An important challenge is to partition the observations to suitable macro states to improve the effectiveness and efficiency of the learning algorithm. Typically, aggregation algorithms, e.g., the adaptive vector quantization algorithm (AVQ), that dynamically partition the state space during runtime are preferred here. In this paper, we integrate the AVQ into an adaptive simulation algorithm.

Item Type: Article
Uncontrolled Keywords: adaptive algorithms, reinforcement learning, component-based simulation software, dynamic state space representations
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
QA75 Electronic computers. Computer science
Depositing User: EAI Editor IV
Date Deposited: 09 Jul 2021 08:27
Last Modified: 09 Jul 2021 08:27
URI: https://eprints.eudl.eu/id/eprint/4339

Actions (login required)

View Item
View Item