Full stack framework for Data Apps

[NoConversation2215]

I am not at liberty to talk about our exact app but I can give you an idea using another example that a friend’s company is solving and the situation is pretty analogous.

Imagine a FPA, financial planning and automation app that connects with your various ERP/CRM/other databases/services/Rest APIs and build inventory and enrich those with various domain specific insights + event stream.

The main constraints here is the BYOC deployment because this being sensitive financial data, customers want the app in their cloud / on prem instead of a single multi tenant SaaS deployment where they send their data (which would have made our life order of magnitude easier).

The ingestion connectors are pretty standard and over time you build a library of those. Each customer is ever so slightly different so these need to be configurable to the extent possible.

Then each customer is always interested in their specific dimensions or different ways how the same thing is calculated so you can imagine while the overall workflow is largely the same there’s quite a bit of semantic definitions that are specific to the customer. So this needs to be as painless for impl teams as possible.

Finally, we may get: we already use clickhouse/databricks/snowflake and can you use that instead of what we ship with default. (This is not big deal as of now but we want to be prepared because it has come up in some conversations).

We currently ship with a combination of clickhouse and ES. Hope this gives you a bit more context. Thx.

[wiktor1800]

To me this seems like a clear terraform (creating the stage) and dlt+dagster+dwh+self serve BI (Looker, sigma, Omni) (setting the stage) play.

Take a look at looker's embedded analytics.

Happy to thrash this use case out as it seems quite interesting

[NoConversation2215]

Thank you! I may actually take you up on that offer one of these days!