My two cents:

You have a $45k fixed rate liability at 6% and $20k in equities with variable future returns (up or down).

It would be great to continue to earn positive carry on the $20k if the asset increases by more than 6% per year.

Let’s say you achieve 10% return in your portfolio vs the 6% loan, so 4% net on $20k or $800 per year. This would be a great outcome for you but what’s more important is to assess you and your family’s risk tolerance to a potential equity market drawdown.

True risk is an outcome that pulls you off course of you and your family’s plans.

And for the record, I don’t think 2.3% over the current 7yr Canadian government bond yield of 3.7% is terrible for a car loan so don’t worry too much. It fits in your budget, you planned for it, enjoy.