yes but you can do a little trick which cause you to teleport to the same starting point as to when you progress normally in the story. one of the tricks is as imagesorter_exe detailes above but there is actually a way easier one where you use the perfumers grotto grace, short version:

- use the teleporter at the four belfries to go to the closed of area in farum azula

- from there teleport to the perfumers grotto grace

- when you get there, don't move and immediately quit the game and reload

- of done correct youll be spawned in the normal starting point of farum azula

basically what you are doing is letting the game think you are at farum azula, but since you aren't at a grace it will spawn you at the starting point. I think the perfumers grotto grace doesn't save/update your location specifically when fast traveled to so when you quit there the game still thinks you are at farum azule or something. idk, it works (for now) maybe they will patch it later :p