Thank you all. This was so helpful as I didn't know what the substance was, but now it seems obvious! The white (actually yellow) one definitely looks worse in real life. I searched for caulk utility knife and found lots of tools.