-
gpt_bpe Public
Forked from wbrown/gpt_bpeGPT2 Byte Pair Encoding implementation in Golang
Go GNU Lesser General Public License v2.1 UpdatedMay 1, 2024 -
-
sentencepiece Public
Forked from google/sentencepieceUnsupervised text tokenizer for Neural Network-based text generation.
C++ Apache License 2.0 UpdatedApr 3, 2023 -
tokenizer-gpt2-genji Public
huggingface transformers compatible GPT2Tokenizer files for genji-v2 model
1 UpdatedFeb 19, 2022 -
memory-efficient-attention Public
Forked from AminRezaei0x443/memory-efficient-attentionMemory Efficient Attention (O(sqrt(n)) for Jax and PyTorch
Python UpdatedFeb 2, 2022 -
transformers Public
Forked from huggingface/transformers🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
-
-
gpt-neo_dungeon Public
Colab notebooks to run a basic AI Dungeon clone using gpt-neo-2.7B
-
lm-evaluation-harness Public
Forked from EleutherAI/lm-evaluation-harnessA framework for few-shot evaluation of autoregressive language models.
Python MIT License UpdatedJun 29, 2021 -
-
mesh-transformer-jax Public
Forked from kingoflolz/mesh-transformer-jaxModel parallel transformers in JAX and Haiku
Jupyter Notebook Apache License 2.0 UpdatedJun 10, 2021 -
DeepSpeed Public
Forked from deepspeedai/DeepSpeedDeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.
-
onnxruntime Public
Forked from microsoft/onnxruntimeONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
C++ MIT License UpdatedMay 7, 2021