v0.4.1

   🚨 Breaking Changes

• Drop unused getEmbeddingContextSize function  -  by @johannschopplich (3ee97)

   🏎 Performance

• Cache split regex  -  by @johannschopplich (94331)

    View changes on GitHub

v0.4.0

   🚨 Breaking Changes

• Rename package to tokenx  -  by @johannschopplich (4a8ed)

    View changes on GitHub

v0.3.6

   🚀 Features

• Support GPT-4o "omni" model  -  by @johannschopplich (5e03f)

    View changes on GitHub

v0.3.5

   🚀 Features

• Update latest GPT model names  -  by @johannschopplich (2f6ff)

    View changes on GitHub

v0.3.4

   🐞 Bug Fixes

• Add missing gpt-4-turbo-preview  -  by @johannschopplich (a57b8)

    View changes on GitHub

v0.3.3

   🚀 Features

• Add latest GPT models like gpt-4-vision-preview  -  by @johannschopplich (7464c)

    View changes on GitHub

v0.3.2

No significant changes

    View changes on GitHub

v0.3.1

   🚀 Features

• Numeric sequences are often a single token  -  by @johannschopplich (ffa6a)

    View changes on GitHub

v0.3.0

   🚀 Features

• Support CJK languages  -  by @johannschopplich (11ec1)

    View changes on GitHub

v0.2.0

   🚀 Features

• Closer token estimations to GPT tokenizer  -  by @johannschopplich (a9cff)

    View changes on GitHub