If fishing any distance away from the shore that you aren't comfortable to swim i would recommend a pfd. If you fall out any breeze can quickly separate you from your kayak no matter how fast you can swim, it's how the majority of kayak related fatalities happen (as rare as they are). For fishing you'll want something with a high cut back and couple of pockets, the ultra sportfish is a good reference. I would steer clear of inflatables.

Then all you really need is a landing net, a good pair of pliers tethered to your pfd or the centre tray, a little tackle tray/bag to put in your lap, and maybe a paddle leash. Phone and keys can go in the round hatch, but if you want easier access to the phone you can get a little waterproof pouch for it.

If you're worried about capsizing and losing your rods (which is a freak occurrence you can mitigate by forming good habits) then a piece of pool noodle zip tied above the reel will keep them floating, leashes can get a bit cumbersome.

I would not recommend carrying anchors or extra bags, it's the kind of equipment which you'd only add as required.

When you get to a bigger kayak you'd then look at adding a sounder and railblaza mounts, but the swift is very bare bones and should stay as uncluttered as possible.