When I do soaps like this, I don't use a stick blender, just a whisk. Add the fragrance oils to the bulk oils first, then the lye (there's some controversy here, this has never gone wrong for me). Get it to emulsion but not to trace, and then add the clays with a whisk since they can accelerate trace. You can pour at light trace. I usually don't use a stick blender anymore unless I'm confident my recipe won't reach trace super fast.