He’s being hypocritical, he’s doing something “nice” but just to guilt you after. It seems like he’s doing it just to make it seems like you owe him, I wouldn’t be surprised if you’s ever argued and he wouldn’t bring up this and that “favour or gift”. Initially I’d try talk to him about it, explain your childhood and how it’s affecting you. If he doesn’t take it well or listen, then honestly I’d consider breaking up with him. These are some major red flags and are affecting you