This repository is based on https://github.com/karpathy/nanoGPT
This repository was used to write a paper in the Master Module Neural Network at the University of Hamburg Summer Semester 2023
To reproduce a similar model to the one used in the paper, install the requirements in a python VE and run 'python train.py config/finetune_lyrics.py' using a device with Cuda enabled and about 11 GB of VRAM.