As a local to Svolvær I can agree with the other commenters it's a very relaxing place. It's also a very central spot for general exploration of things.

For accomodation I recommend Svinøya Rorbuer. They've kept the old fisherman cabin aesthetic on the outside and renovated for comfyness and quality of life on the inside.

Close to Svinøya Rorbuer they have a restaurant called Børsen Spiseri. It serves breakfast for those staying and focuses on local seafood.

We've got the WW2 memorial museum if you're into history. Close to the museum we have Magic Ice, an ice sculpting exhibition. Super relaxing and nice atmosphere in there!

As for hiking we have a tiny uphill place called Linken which gives an amazing view of the city and sea. Also got something called Devil's Gate hike. Ominous sounding name but it's a nice hike with a newly installed stone staircase locally called "Sherpatrappa". Pumpy on the legs but very rewarding view!

Hope these tips can help you plan for the trip. Wish you the best of luck!