Skip to content

A simple benchmark script to automate testing ollama model eval rates.

License

Notifications You must be signed in to change notification settings

savoirtech/windows-ollama-benchmark

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

This tool is intended to help automate testing generative text models on Ollama.

Users specify the number of times they would like to run ollama with a standardized prompt.

The script then runs ollama N times and provides an average eval rate in Tokens/Second.

Note: Batch scripts operate on Integers, so some precision is lost.

Usage

C:\>Path\To\Tool>ollamaBench.bat

Run Time Sample

OllamaBenchmark

About

A simple benchmark script to automate testing ollama model eval rates.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published