- Move alfworld directory and install requirements
cd ./alfworld
pip install -r requirements.txt
-
According to the instruction, download the data and set environment variables
-
Prepare OpenAI API key and put the key in
OpenAI_api_key.txt
-
Run RAP on ALFWorld
python main.py
Following are the hyper-parametes for RAP.
- num_trials: Number of recursive trials. Default is 3.
- num_steps: Maximum steps in one task. Default is 50.
- model: Model to be used in evaluation. Default is "gpt-3.5-turbo-instruct".
- output: Folder path to output logs and memory.
- emb_model: Embedding model to be used in evaluation. Default is "sentence-transformers/all-MiniLM-L6-v2".
Also, Python 3.11 is recommended for evaluation.