Release v0.0.9

Updates:

• Add TransformerCorrector
• Fixed Trie.show() for better display

Release v0.0.8

Updates:

• Remove extra dependencies pycorrector, kenlm in setup.py
• Add these extra dependencies to requirements-extra.txt

Release v0.0.7

Updates:

• Remove from naivenlp.correctors.kenlm_corrector import KenLMCorrector imports from naivenlp/__init__.py due to pycorrector's compatibility issue.

Release v0.0.6

Updates:

• Add Trie data structure
• Update texts.py module
• Add usage examples to README

Release v0.0.5

Updates:

• Append special tokens tp vocab list instead of inserting it to index 0.
• Add script to download sogou vocabularies.

Release v0.0.4

Updates:

• Add similarity module
• Refactoring tokenizers module to better build vocab from vocab file

Release v0.0.3

Updates:

• Add wrapper for pycorrector

Release v0.0.2

Updates:

• Add jieba tokenizer wrapper

Release v0.0.1

Updates:

• Init project, add GitHub Actions
• Add tokenizers interface, refactoring jieba