rddlgym: A toolkit for working with RDDL domains in Python3.
Project description
rddlgym 
A toolkit for working with RDDL domains in Python3. Its main purpose is to wrap a RDDL domain/instance planning problem as an OpenAI gym environment.
Quickstart
$ pip3 install -U rddlgym
Usage
rddlgym can either be used as a standalone CLI app or it can be integrated with your code in order to implement customized agent-environment interaction loops.
CLI
$ rddlgym --help
Usage: rddlgym [OPTIONS] COMMAND [ARGS]...
rddlgym: A toolkit for working with RDDL domains in Python3.
Options:
--help Show this message and exit.
Commands:
info Print metadata for a `rddl` domain/instance.
ls List all RDDL domains and instances available.
parse Check RDDL file parsing.
run Run random policy in `rddl` domain/instance.
show Print `rddl` file.
API
# create RDDLGYM environment
rddl = "Navigation-v3" # see available RDDL with "$ rddlgym ls" command
env = rddlgym.make(rddl, mode=rddlgym.GYM)
# define random policy
pi = lambda state, t: env.action_space.sample()
# initialize environament
state, t = env.reset()
done = False
# create a trajectory container
trajectory = rddlgym.Trajectory(env)
# sample an episode and store trajectory
while not done:
action = pi(state, t)
next_state, reward, done, info = env.step(action)
trajectory.add_transition(t, state, action, reward, next_state, info, done)
state = next_state
t = env.timestep
print(f"Total Reward = {trajectory.total_reward}")
print(f"Episode length = {len(trajectory)}")
filepath = f"/tmp/rddlgym/{rddl}/data.csv"
df = trajectory.save(filepath) # dump episode data as csv file
print(df) # display dataframe
License
Copyright (c) 2018-2020 Thiago Pereira Bueno All Rights Reserved.
rddlgym is free software: you can redistribute it and/or modify it under the terms of the GNU Lesser General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.
rddlgym is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU Lesser General Public License for more details.
You should have received a copy of the GNU Lesser General Public License along with rddlgym. If not, see http://www.gnu.org/licenses/.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
