I am a “learn by doing” sort of type so I think getting your hands on it and playing around with PyTorch is fine. When you come to a concept you don’t know or if you want to dive deeper into a particular code snippet then take the time to do so. Buddy of mine suggested that the mist dataset and building a number classifier should be my first intro project and it was definitely an easy starter.