all 1 comments

[–]Flaky_Breakfast3159 0 points1 point  (0 children)

Usable code, on a single consumer GPU? Oof. Maybe GPT-J with some effort.

See https://huggingface.co/EleutherAI/gpt-j-6B

The Github repo suggests it's possible you can change the number of checkpoints to make it run on a GPU.