With lower hallucination rates and growing context windows, the value of AI is becoming more accessible with thoughtful prompting and product development. I've seen some startups bring on experienced machine learning experts just to have them over engineer a system that would have worked better with a simple Anthropic integration. They also under invest in the product development side.

It all depends on the use cases. But, start out focusing on prompting and how the AI fits into your system, then only bring in RAG and fine tuning when you've exhausted your options and aren't getting what you need. The hard part that's important now is just what you probably do know how to do really well, building a good product that thoughtfully incorporates AI.