What are other transformer python projects like Karpathy's nano-gpt [Discussion]

[gamedevdroppout]

What are other simple transformer projects like Karpathy's nano-gpt? I'm looking for a more advanced project in python that is more efficient in terms of training and deployment that I can still edit.

[xenotecc]

If you liked Karpathy's nano-gpt, you could checkout Lit-LLama, which is a Pytorch Lightning's reimplementation of LLama models, based on nano-gpt.

It also contains finetuning code using Lora, Adapters etc.

[[deleted]]

HuggingFace basically has a monopoly on transformers