Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
-
Updated
Nov 14, 2024 - Python
Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
Training GPT-2 on FineWeb-Edu in JAX/Flax
Add a description, image, and links to the fineweb topic page so that developers can more easily learn about it.
To associate your repository with the fineweb topic, visit your repo's landing page and select "manage topics."