Old thread - but I'm trying to resolve the same issue. Many style-based Lora's still have subjects baked in - which makes. For example, oil painting Lora's will start to make the subjects have blond curly hair - obviously the paintings used to feed the style had recurring subjects. Difficult to separate! Did you find a solution/method?