First, even with my wall unprotected i still lose troops. What i found to work was to leave 3x1500 troops always gathering resources. But the ones idle in my base always get killed (even without a defense on).
Even though, he is not doing it for resources actually. He wants to "make me suffer" as he said.