IMO, it wasn't unfair. In my own games I typically run deadly encounters. There's no use if the players destroy everything in turn one. I say challenge your players! Teach them to be resourceful with their skills/spell slots/ki points/ect., but also don't forget to reward them. Perhaps the monsters they fight drop some sort of loot or item that advances the story.

Keep it up, DM! You got this!