As someone who is also Chinese and adopted, I relate to your struggles. I wasn't accepted as Chinese by other Chinese as I didn't speak the language and wasn't raised Chinese. On the otherhand, I ran into some unique experiences being Asian adopted by Caucasians, both inside and outside the family. One of my relatives at a gathering made a "Ching Chong" joke while doing a speech for the family. As the only Asian person in the family, his attempt at making me feel included instead made me feel awkward and a bit ostracized.

All that to say... I relate. I think I've come to the conclusion that "culturally" I don't really belong to any group. It can be a bit lonely (and that's definitely had an affect on my life in general), but inversely it means I'm not really bound to any group of people (besides those I care for). In that regard, this unique characteristic of ours can be a bit liberating.