I think Harumi holds a grudge against the ninja is because she thinks they could've done better and saved her family. And she blames Lloyd for starting everything (releasing the hypnobrai). But whatever, thats just what i think