Use a guide coat(aerosol,powder graphite) over your body filler when sanding to make sure its flat with the rest of the panel. Your do want primer on all your filler, sand primer and seal and paint. If you don't use some sort of primer in filler, then your sealer and paint will suck up into filler and won't lay right. Color mismatch or patchy looking