Skip to content

Commit

Permalink
baseline
Browse files Browse the repository at this point in the history
  • Loading branch information
leeyeehoo committed Sep 30, 2023
1 parent ccb9503 commit 5574287
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions llm_judge/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,9 @@ python gen_model_answer_medusa.py --model-path FasterDecoding/medusa-vicuna-13b
python gen_model_answer_medusa.py --model-path FasterDecoding/medusa-vicuna-33b-v1.3 --model-id medusa-vicuna-33b-v1.3-0
```

- Run baseline: replace `gen_model_answer_medusa.py` with `gen_model_answer_baseline.py` (Please note we only implement the greedy inference for wall-time comparison. If you want to use the sampling generator, please refer to the original repository.)


- Query the results

```
Expand Down

0 comments on commit 5574287

Please sign in to comment.