huggingface-smol-lm

Here is 1 public repository matching this topic...

MyDarapy / SmolLM-experiments-with-grouped-query-attention

(Unofficial) building Hugging Face SmolLM-blazingly fast and remarkably powerful small language model with PyTorch implementation of grouped query attention (GQA)

transformer attention smol huggingface ml-efficiency llm grouped-query-attention smol-lm huggingface-smol-lm

Updated Oct 11, 2024
Python

Improve this page

Add a description, image, and links to the huggingface-smol-lm topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the huggingface-smol-lm topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

huggingface-smol-lm

Here is 1 public repository matching this topic...

MyDarapy / SmolLM-experiments-with-grouped-query-attention

Improve this page

Add this topic to your repo