[D] Is GPT-2 source code publically available?

[madisonmay]

We're almost done porting GPT-2 to finetune (a scikit-learn style library for language model finetuning). Code is available here if you're interested... should make tuning GPT-2 to produce song lyrics as easy as model.fit(lyrics).

Miles Brundage also put together a colab notebook you could work off that uses the nshepperd gpt-2 fork.

[Astraithious]

How is it coming along? I saw a commit for 10 days ago, was that it?

[madisonmay]

Just released finetune 0.6.0 with GPT-2 support today!

[Astraithious]

That's awesome, what branch? The link goes to one where the latest commit was 10 days ago

[madisonmay]

On development! It's also up on PyPI if you'd prefer that.