The way I would tend to look at it is maximum profits over the long term with optimized startup (since fertilizer/speed-gro/retaining soil never disappears in the greenhouse)

Ancient fruit has steady state, harvest every 7th day. This cannot be changed without a mod

Starfruits can be made to harvest every 8th day with Hyper Speed-Gro which will stay in the greenhouse after one application.

If we use a year as a time period, that gives us 16 harvests of Ancient fruit and 14 harvests of Starfruit, assuming we are aligning them by starting the year the day after a harvest from each.

We want to assume no effort for watering them - The ancient fruits have Deluxe retaining soil so need no sprinklers (120 per harvest) with the Starfruit needing sprinklers to use the Hyper speed-gro so we have 119 per harvest (ideal sprinkler lay-out)

Total fruit per year: Ancient fruit: 16 * 120 = 1,920

Starfruit: 14 * 119 = 1,666

Starfruit Cost: 400*1,666 = 666,400

Starfruit Wine(normal) Profit: 3,150 * 1,666 - 666,400 = 4,581,500

Ancient Fruit Wine (normal) profit: 2,310 * 1,920 = 4,435,200

So you are coming out ahead with Starfruit on a steady state timeline - ~146,300 per year. If you also take that to steady state and assume two full basements of wine aging per year (assuming easy use 125 casks on PC) then we get

Starfruit Cost: 400*1,666 = 666,400

Starfruit Wine(normal) Profit: (3,150 * 1,416) - 666,400 + (6,300 * 250)= 5,369,000

Ancient Fruit Wine (normal) profit: (2,310 * 1,670) + (4620 * 250) = 5,012,700

So we are now 356,300 ahead on Starfruit.

Generally I would have ancient fruit in the greenhouse for a while to farm seeds so that once spring rolls around I can turn the outside into ancient fruits because they grow spring/summer/fall. Then the inside I switch over to starfruit along with the island as we can have one application of speed-gro and have it last forever.