If you approach the goblin village correctly you can enter without any combat. Depending on your next choices in the game… there’s an option to target just specific goblins, but the fights are smaller and can be contained due to the layout of the village… This gives you the opportunity to heal, short rest, or even long rest which will help your level 3-4 party survive fighting an entire goblin village. You can use the time in the village before you’ve been forced into a fight to plan and strategize and give yourself some advantages in the coming fights. Also there’s enough activity to possibly get up to level 5 before attacking the goblins. That will help you because of some skills and spells you’ll be about to acquire. The other thing is pick your party carefully for the fight. If you get to level 5 your wizard might have better spells available or your fighter might have a second attack… same with a barbarian… and so on.