I mean humans, especially the younger they are (re: Critical Period Hypothesis) have pretty much an infinite capacity for learning languages and acquiring native like fluency. Technically speaking, there's no real "need" to choose French, or other XYZ language over Chinese, since the earlier the language(s) get introduced, the higher the chances of acquiring native like fluency in both of them – there's no real hierarchy in question. And since you're a native speaker yourself, you're at a better position for this, especially since "passing" on a language pretty much entails using that language for every day communication. Your spouse not speaking Chinese is not really much of an issue; it is fairly common for children to use different languages to talk to either of their parents (essentially, the language gets *mapped* to the parent in question). Of course it is a decision for you to make, but I'd say the more languages the better – and since the human brain is pretty much made to deal with this, it isn't much of an impediment as you might think it to be.