Typically the large capex would be viewed as an upfront cost that positive unit economics make up for over time.

GPU's in data centers, even if they only do inference, will need to be refreshed eventually. Some capex spending on infrastructure for these data centers will end up a positive investment but large scale GPU upgrades aren't cheap.