#

smol-lm

Here is 1 public repository matching this topic...

MyDarapy / SmolLM-experiments-with-grouped-query-attention

(Unofficial) building Hugging Face SmolLM-blazingly fast and small language model with PyTorch implementation of grouped query attention (GQA)

transformer attention smol huggingface ml-efficiency llm grouped-query-attention smol-lm huggingface-smol-lm

Updated Jan 11, 2025
Python

Improve this page

Add a description, image, and links to the smol-lm topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the smol-lm topic, visit your repo's landing page and select "manage topics."