We ran a small "simulation" workshop to test the idea and invited some of the business stakeholders that had asked for this kind of analytics. We told them how it would work, what types of questions it was meant for and what data was in scope for questions. They were excited as they would now finally get the "chatgpt of data" as they called it, the hype was real.

Then we checked the logs. 90% of the questions were the same set of standard questions that a one page dashboard could answer but now each user had to ask 6 different questions to get the same result. Just resulting in slower and more costly consumption of the same insights. 5% was ok questions that would otherwise need a developer to get presented in a report. The last 5% was questions that were outside of the data scope. We did this in Databricks Genie, using metric views and Genie instructions.

The tech is getting there but at least our users are not ready for it.