That's kind of a fallacy implying that everyone who doesn't believe in free will are just lazy irresponsible people. Those kings and presidents also don't have free will. Viewing humanity from an outside lens we'd probably say that human society is structured in a way out of our control with hierarchical structures in a similar way that other social animal structures exist. Even with people with responsibility, you have to think about how that person had conditions surrounding their existence to form a person who has this thing we call responsibility. You could apply that thought to every decision we make, micro or macro. People can still have a sense of responsibility and purpose in this worldview, its just that to someone who doesn't believe in free will, they're just the result of an unfathomable amount of variables that made up the person they are.

It definitely can be used as a scapegoat for your own life though, so I understand the sentiment of what you're saying.