games project

Publications

Feb 1, 2011

A Reinforcement Learning based Self-healing Algorithm for Managing Context Adaptation


T. Cioara, I. Anghel, I. Salomie, M. Dinsoreanu, G. Copil, D. Moldovan - A Reinforcement Learning based Self-healing Algorithm for Managing Context Adaptation, iiWAS 2010, Nov. 2010, Paris, France, http://www.iiwas.org/conferences/iiwas2010/index.php, http://www.iiwas.org/conferences/iiwas2010/program.phpto be published, ACM INDEXED

Category: Publications
Posted by: alerox
In this paper we approach the context adaptation problem by defining a self-healing model that uses a policy-driven reinforcement learning mechanism to take run-time decisions. The self-healing property is enforced by monitoring the system’s execution environment for evaluating the degree of fulfilling the context policies in the current context situation, and selecting the healing actions that may be executed. For action selection a reinforcement learning based approach is used to generate the best sequence of actions to be taken for keeping the context resources as close as possible to a policy compliant state.