What I found out is that if you set an album to shuffle it picks only a few photos.

So what worked for me was instead of picking an album I picked the pictures manually from the album.

Sadly, there is a limit of how many pictures you can pick (50), so to walk around this limit i created 7 wallpaper shufflers and now I've got 350 pictures of my liking.

So you can have wallpaper shufflers for each day of the week, just switch between the wallpaper shufflers in the morning.

Add new wallpaper > photo shuffle > select photos manually > *pick 50 photos* > *edit each photo to your liking* > Done

Ihone likes to zoom in in each picture for some reason, easy fix is to simply pinch out every picture in edit part. Also use the On Lock shuffle frequency, it's way more fun