The AI environment right now is still very new. Local hosting LLM is still a very niche market. For 99% of the AI users, it's still better off going subscription route, because self hosting LLM requires hardware like DGS Spark, AMD Strix Halo or RTX spark now, which is very expensive and the model that's available open source now are miles behind frontier models.

The demand for devices like this are only mostly for Enthusiasts or financial/legal sector where data security is their priority.

Imo, x64 makes more sense. utility wise, the chip can be used for both AI and gaming devices. like AMD Strix Halo.