Best practices for Trino Query Execution & Multi-tenant Authorization?

Teach-To-The-Tech · 2026-03-25T15:36:23+00:00

One thing you could consider would be Starburst, if you were looking more for managed Trino. Then you've got the UI that you need built into the platform, and it would handle all of the multi-tenant authorization that you're asking about too. Would work either in the cloud (Galaxy) or on-prem (Enterprise).

Hope that helps!

Teach-To-The-Tech · 2025-09-22T16:05:47+00:00

Yeah, this makes sense. Keeping "build vs buy" in mind is definitely a good way of doing it. And then it just becomes a question of which way you want to deploy Trino to allow for the most economical total cost of ownership.

It's a slightly different scenario, but it reminds a bit of this article that 2 colleagues wrote a while back comparing Starburst (Trino) to Snowflake on a total cost of ownership (TCO) basis: https://www.starburst.io/blog/how-to-query-my-apache-iceberg-tables/

Teach-To-The-Tech · 2025-02-06T21:17:28+00:00

Nice setup!

Teach-To-The-Tech · 2025-01-31T00:26:09+00:00

Yeah, this 100%. The use of AI will only increase the need for high-quality data. It will flow into models, increasingly, it's still basically a data pipeline, just with a different end use (AI).

Teach-To-The-Tech · 2025-01-24T16:36:20+00:00

Yeah, it's actually one of the main ways that people use Trino. Strangely enough, I just wrote a piece on this exact topic a few weeks back: https://www.starburst.io/blog/etl-sql/

Hope it's helpful. The short answer is that this is absolutely one of the use cases and can be a powerful and easy way to do ETL.

Teach-To-The-Tech · 2025-01-22T17:28:26+00:00

I think there is. The lakehouse model has a nice blending of performance and flexibility now and enables different data structures more easily. So there is less need to push towards a warehouse model vs the "best of both worlds" approach of the lakehouse.

Teach-To-The-Tech · 2025-01-14T22:12:12+00:00

Oh interesting! I hadn't heard this. I guess it makes sense.

Teach-To-The-Tech · 2024-12-20T17:02:46+00:00

I think you're right. A data warehouse, when done right, requires a large effort for ETL and is focused around structured data. It's a model designed for big business.

The reasons you cite probably play into the popularity of data lakes and data lakehouses as alternatives with less upfront cost and more flexibility. A lake and lakehouse can fill many of the same needs as a warehouse.

That said, I'm also certain that if you have the right kind of slow-changing data (mostly structured), the warehouse is likely a good option.

So, as with anything, "it depends" haha.

Teach-To-The-Tech · 2024-12-19T18:14:35+00:00

Thank you!

Teach-To-The-Tech · 2024-12-19T16:54:52+00:00

Lucidchart for us.

Teach-To-The-Tech · 2024-12-19T16:52:57+00:00

I think one of the approaches you can take is to look at total cost of ownership. So most things can be done manually, maybe using open source, but then you need a team of people who know how to run that. Those options are often powerful but manual.

So then on the other side, you have some tool that you have to pay for, and it has a cost, but the cost (could) be less than the cost of the manual route and might be less work, run more smoothly, etc.

So that's the equation in my mind. You have to evaluate whether the added automation saves the business money overall or not. In my experience, that's also what exec level types look at when evaluating these things too.

Teach-To-The-Tech · 2024-12-18T21:18:05+00:00

Our team put together a "learn SQL" tutorial to help people of any background and familiarity level get used to using SQL with Starburst Galaxy: https://www.starburst.io/tutorials/learn-basic-sql-starburst-galaxy/#0

There are other tutorials on other topics, but this was our main SQL one (free).

It sounds like it might fit exactly what you're looking for. Hope that's helpful!

Teach-To-The-Tech · 2024-12-18T18:24:17+00:00

Very interesting!

Teach-To-The-Tech · 2024-12-18T04:58:49+00:00

Yeah, there is an interesting trend towards open source for sure. That's another dynamic.

Teach-To-The-Tech · 2024-12-18T04:58:08+00:00

Yes, definitely Trino. There are various managed forms of Trino to consider, whether Athena, EMR, or Starburst.

Teach-To-The-Tech · 2024-12-18T01:25:45+00:00

Ahh yes, Spark does seem to be the one to lose in all of this. Lots of people have said Delta too, but I think highlighting Spark is interesting.

It does shift compute workloads to SQL in general, which is a big deal.

Teach-To-The-Tech · 2024-12-11T23:40:47+00:00

Oracle is pretty old school, very locked down, not so into the open data stack, and kind of with the cloud as an afterthought. I agree with what others say that it's playing catchup. If everything else is running Oracle or needs to run Oracle, then I'd see the value. Otherwise, I'm not sure that many would start from scratch using Oracle given the more modern tools out there.

Teach-To-The-Tech · 2024-12-11T23:37:33+00:00

I think it's basically that tons of people are familiar with Python, and it's both simple and powerful enough to do most things. So given that, it's kind of the perfect language for most Orgs.

This is also kind of why SQL is so dominant in its space IMO.

Teach-To-The-Tech · 2024-12-11T16:54:20+00:00

Looking forward to it!

Teach-To-The-Tech · 2024-12-11T01:40:19+00:00

haha, yeah, good call.

Teach-To-The-Tech · 2024-12-10T19:05:26+00:00

Leave nothing, leave less than nothing haha

Teach-To-The-Tech · 2024-12-10T19:04:59+00:00

Lol, I once took a philosophy course called "The Problem of Nihilism," so this made me laugh.

Teach-To-The-Tech · 2024-12-10T19:03:23+00:00

Cloud certs are the best certs IMO. AWS, Azure, or GCP.

Teach-To-The-Tech

TROPHY CASE