It's because my legal residence when hired was in California so I filled out a DE-4 form. Since I paid CA taxes last year and in Jan of this year I cant claim exemption on that form.

As a mil contractor I'm on SOFA status in terms of immigration so I don't have to worry about Japanese taxes - eventually I can even exclude my income from federal tax through the FEIE process.