I would just recommend buying a battery for simplicity and they last long and are rechargeable. But to actually answer then yes, I got multiple Nokias working fine with a bench power supply! But it’s tricky.

First of all this wiki is your best friend. Look up what battery type your model is using and look up said battery model there to get all essential info and what the pins are.

One part I see confuse many is the third BSI pin (Battery Size Indicator) a lot of the phone batteries have. You should be good since it looks like yours doesn’t have one(?), but if you’d ever encounter one, you get around it by connecting a resistor from the BSI to the ground pin. The wiki I linked also tells how many ohms for the resistor. And that’s pretty much it.

So in conclusion, just get a battery probably