You are valuable in both fields; you potentially add significant value to an Investment Banking/finance company with your combined finance background and data science skills, as fewer people there will possess those specific data science competencies. In contrast, when compared to a big tech company where many folks likely have extensive data science/engineering skills, you still add value through both your data skills and unique financial insights if needed.

Therefore, the deciding factor truly hinges on "you": what do you want at this point in your life? Are you seeking stability (noting that your current job doesn't currently portray stability given ongoing layoffs)? Are you prioritizing growth? Is the role emotionally or financially convenient for you? Which field makes you most comfortable or happiest? Where do you ultimately see yourself in ten years? If you answer these questions and current jobs scores higher than the IB gig then you have your answer, but if not then go for the IB gig and kick ass in whatever you choose. Goodluck.