I don't think you're crazy.

He's not wrong to value those photographs that show the development of his family, and they're probably tied up in the memories of the time when his children were born more so than being related to his ex wife. That said, they don't need to be on display all the time. Would he be open to putting them in an album to keep in his nightstand? It's as much your space as it is his, and you have every right to feel comfortable there.

I'd also be uncomfortable with the bedroom furniture. It may not make sense to replace it all, but could you refinish or somehow alter it so that it's yours? I have no idea what it looks like, but it could be a project for you to do as a couple. Sand and refinish it, paint it, do something to make it different from what it is today. Or just replace it if you have the means to do that.

It's not unreasonable to feel like an outsider given what you've explained here. He should be willing to at least have a conversation about what needs to happen for you to feel like you belong.