-
Notifications
You must be signed in to change notification settings - Fork 6
Home
Welcome to the gym-novel-gridworlds wiki!
Gym Novel Gridworlds are OpenAI Gym environments for developing and evaluating AI agents that can detect and adapt to unknown sudden novelties in their environments.
There is a crafting table in the grid world. The goal is to get in front of the crafting table as soon as possible.
Type: Box(10)
Lidar sensor: 5 beams at equally spaced angle (45 degree) in front of agent that looks for crafting table and wall.
Type: Discrete(3)
Forward, Left, Right
50 in front of crafting table, -1 otherwise
Initial state: {'crafting_table': 1, 'tree': 5} in the grid world.
Goal: Go in front of 3 trees and break them.
Type: Box(81)
Lidar sensor (8 beams x 9 items) + inventory_items_quantity (9 items)
Type: Discrete(4)
Forward, Left, Right, Break
10 to break a tree and 50 if 3 trees are broken, -1 otherwise
Initial state: {'crafting_table': 1, 'tree': 2} in the grid world and {'log': 3} in the inventory.
Goal: Craft 8 plank and 8 stick.
Type: Box(81)
Lidar sensor (8 beams x 9 items) + inventory_items_quantity (9 items)
Type: Discrete(2)
Craft_plank, Craft_stick
10 to craft an item, 50 to reach goal, -1 otherwise
Initial state: {'crafting_table': 1, 'tree': 2} in the grid world and random number of {'plank', 'stick'}, and {'rubber': 1} in the inventory, 50% times there is wall in front of agent.
Goal: Craft 1 tree_tap or 1 pogo_stick.
Type: Box(81)
Lidar sensor (8 beams x 9 items) + inventory_items_quantity (9 items)
Type: Discrete(4)
Forward, Left, Right, Craft_tree_tap, Craft_pogo_stick
10 to craft an item, 50 to reach goal, -1 otherwise
Initial state: {'crafting_table': 1, 'tree': 2} in the grid world and {'tree_tap': 1} in the inventory.
Goal: Place tree_tap and extract rubber.
Type: Box(81)
Lidar sensor (8 beams x 9 items) + inventory_items_quantity (9 items)
Type: Discrete(5)
Forward, Left, Right, Place_tree_tap_Extract_rubber
20 to place tree_tap and extract rubber, 15 to extract rubber, 50 to reach goal, -1 otherwise
- Go in front of 3 trees and beak them (NovelGridworld-v1).
- Craft 8 plank and 8 stick (NovelGridworld-v2).
- Craft 1 tree_tap (NovelGridworld-v3).
- Place tree_tap and extract rubber (NovelGridworld-v4)
- Craft 1 pogo_stick (NovelGridworld-v3).
Type: Box(81)
Lidar sensor (8 beams x 9 items) + inventory_items_quantity (9 items)
Type: Discrete(9)
Forward, Left, Right, Break, Place_tree_tap_Extract_rubber, Craft_plank, Craft_stick, Craft_tree_tap, Craft_pogo_stick