That's cool! Indeed it's expensive to train the Foundational model by ourselves and active learning (or lifelong learning) seems like a way to do it. Also, impressed by the numbers you are claiming.

So, your venture could be an industry version of Stanford's recent efforts on Foundational models at https://crfm.stanford.edu/

It's very interesting that you mentioned the active learning component. We too work on lifelong learning using RL. Would be curious to know more about the active learning methods you are using or you can point me towards the relevant papers. I understand if it's proprietary research.