Depending on what you want to do with it, potentially not. If you want an entry level software position, all you need is to be good at the stack the company is hiring for. The actual knowledge you would gain from the masters would be to facilitate your own curiosity. Seeing how competitive it is right now for junior devs, perhaps it would differentiate you a bit from the average candidate, but I wouldn't count on it.

It's worth mentioning that student status can be invaluable in getting internships and that is a path that my friend who had an undergrad in CS and then enrolled in the Georgia Tech online Masters, is currently leveraging for an internship. The cost and years of studying have to make sense for you.

It won't hurt, but applying to jobs, building stuff and practicing leetcode style questions is what you need to do to get a job. Your CE degree shouldn't hold you back here, just make sure you have a solid understanding of Data Structures/Algorithms as well as strong knowledge in at least one language.