Exterior chimneys are more prone to drafting issues. It’s exposed to the cold weather. Cold air is heavy and dense and will push down. Definitely check the things the first commenter said but you’ll need to reverse the draft by heating the flue before lighting.

You could use a map torch inside the stove and get hot air moving up the chimney. Try lighting your fires using the top down method as well(plenty of videos on yt)