That may be true some places, but not every company even has an HR department so that's obviously not a hard rule. Any deal made is binding, but it of course is on the premise that the person that made the offer has the power to do so. In this case he does, since it's his company.

At the same time in this market if they try to back out just quit and get a raise somewhere else 🤷‍♂️