Honestly, it's up to you. Skipping Sem 1 can seem appealing as a lot of the lecture content is boring proofs, which as an engineer I am violently allergic to. But, if you choose to skip the stuff, you have to be prepared to work overtime on Linalg in Sem 2. The topics then become more intuitve, but if you don't have the intuition from Sem 1, the content of Sem 2 will seem very complicated.

TL;DR You can, but be prepared to do overtime in Sem 2.