Official Implementations of "Near-Optimal Policy Identification in Robust Constrained Markov Decision Processes via Epigraph Form"

This repository is the official implementation to reproduce the figures in Near-Optimal Policy Identification in Robust Constrained Markov Decision Processes via Epigraph Form.

Please see experiments.ipynb, algorithm-concept.ipynb, and grad-conflict.ipynb.

Requirements

# make sure you are in RCMDP-Epigraph/
poetry install

Run Experiments and Plot the results

Run all the cells in

• experiments.ipynb
• algorithm-concept.ipynb.
• grad-conflict.ipynb.