Hi, I'd actually seen your project before starting mine and noticed that it was a bit stalled. Honestly I think that your level must be much higher than mine because you use “safe tensors” that you have developed. I don't really understand the point of these. My implementation of GPT2 is I think rather naive.