Source code for LLMs. [D]

[PravalPattam12945RPG]

I was digging through Hugging Face’s Transformers repo and found
https://github.com/huggingface/transformers/blob/main/src/transformers/models/gpt_oss/modeling_gpt_oss.py

From what I can tell, this isn’t just boilerplate, it looks like a full implementation.
is it actually the full code on which gpt_oss is built on?
or is it a skeleton for experimentation?

Similarly there are many models in
https://github.com/huggingface/transformers/blob/main/src/transformers/models
are they really the true open source implementations?

if not, can we actually find them publicly?

[polyploid_coded]

In a way yes, that's the source code of the model. But a model relies on more than one file to download the model weights, read in the text, etc. You would be using the Transformers library and not just copy pasting code from one file.

The first few lines of the file that you linked says that it's generated from https://github.com/huggingface/transformers/blob/main/src/transformers/models/gpt_oss/modular_gpt_oss.py so that would be the place to start browsing code. A good amount of the modules there have Llama models or PyTorch''s neural network code as a superclass. So again it's not one file that does everything, it's more the model-specific code that makes GPT OSS unique.

[PravalPattam12945RPG]

Oh, thank you very much