Synthesising Reinforcement Learning Policies through Set-Valued Inductive Rule Learning

Research output: Chapter in Book/Report/Conference proceedingConference paper

Abstract

Today's advanced Reinforcement Learning algorithms produce black-box policies, that are often difficult to interpret and trust for a person. We introduce a policy distilling algorithm, building on the CN2 rule mining algorithm, that distills the policy into a rule-based decision system. At the core of our approach is the fact that an RL process does not just learn a policy, a mapping from states to actions, but also produces extra meta-information, such as action values indicating the quality of alternative actions. This meta-information can indicate whether more than one action is near-optimal for a certain state. We extend CN2 to make it able to leverage knowledge about equally-good actions to distill the policy into fewer rules, increasing its interpretability by a person. Then, to ensure that the rules explain a valid, non-degenerate policy, we introduce a refinement algorithm that fine-tunes the rules to obtain good performance when executed in the environment. We demonstrate the applicability of our algorithm on the Mario AI benchmark, a complex task that requires modern reinforcement learning algorithms including neural networks. The explanations we produce capture the learned policy in only a few rules, that allow a person to understand what the black-box agent learned. Source code: https://gitlab.ai.vub.ac.be/yocoppen/svcn2.
Original languageEnglish
Title of host publicationTrustworthy AI - Integrating Learning, Optimization and Reasoning
Subtitle of host publicationFirst International Workshop, TAILOR 2020, Virtual Event, September 4–5, 2020, Revised Selected Papers
EditorsFredrik Heintz, Michela Milano, Barry O'Sullivan
PublisherSpringer International Publishing
Number of pages17
ISBN (Electronic)978-3-030-73959-1
ISBN (Print)978-3-030-73958-4
Publication statusAccepted/In press - 15 Feb 2021
Event1st TAILOR Workshop at ECAI 2020 -
Duration: 4 Sep 20205 Sep 2020
https://liu.se/en/research/tailor/workshop

Publication series

NameLecture Notes in Artificial Intelligence
PublisherSpringer
Volume12641
ISSN (Electronic)0302-9743

Workshop

Workshop1st TAILOR Workshop at ECAI 2020
Period4/09/205/09/20
Internet address

Fingerprint Dive into the research topics of 'Synthesising Reinforcement Learning Policies through Set-Valued Inductive Rule Learning'. Together they form a unique fingerprint.

Cite this