In this project, I build a character-level transformer-based language model, something like GPT(Generative Pretrained Transformer). Once the model is trained, we can generate infinite text.
Since training on chunk of internet requires a lot of compute and time, here I work with a tiny shakespeare dataset.
pip install -r requirements.txt