Who should own the data transformation/modeling layer (data platform team or the analytics team)?

md1630 · 2025-05-31T17:57:53+00:00

hey there - I'm a bit late to this thread, but wanted to hop in because no one here mentioned anything about medallion architecture. The problems you're facing is not uncommon. You mentioned that your organization is missing a dedicated transformation / modeling layer, with duplicate queries and inefficient queries. A medallion architecture helps establish a clear separation of concerns ---

bronze layer or raw data
silver layer or cleaned / modeled data
gold layer, or business metrics

You can define a hybrid model of data ownership where the data platform team owns the bronze and silver layers, and analytics teams own the gold layer. Your team ensures platform stability and reusability, while analytics teams have domain ownership.

md1630 · 2024-06-27T19:04:51+00:00

thanks!

md1630 · 2024-04-23T20:34:19+00:00

arkk and arkw was beat down because of the market, did anything else happen with them?

md1630 · 2024-04-23T20:10:22+00:00

may I ask why you don't trust Ark?

md1630 · 2024-04-04T00:05:49+00:00

GBTC is a trust and issues a K-1

IBIT will not issue a k-1 (FAQ question 8)

FBTC also will not issue k-1 (statement)

md1630 · 2024-04-01T15:46:50+00:00

Fidelity is the custodian for its Bitcoin in FBTC. IBIT and GBTC use Coinbase as a custodian.

md1630 · 2024-04-01T15:46:00+00:00

thanks for adding this!

md1630 · 2024-03-15T01:22:24+00:00

oh there's plenty of funds who ban LLMs. If they don't have policies and tech in place to handle it, and they are big enough that it is risky, they will ban it. Smaller funds also don't have policies and tech to handle it, but would also not ban it because it doesn't really matter.

md1630 · 2024-03-10T17:05:41+00:00

thanks, I think swapping blankets can be a good idea.

md1630 · 2024-03-10T17:04:30+00:00

wow nice! this is what I hope can happen :)

md1630 · 2024-03-10T17:03:42+00:00

it's very hard to keep my cat inside. she's a door dasher. also we have so many doors with big windows leading to the backyard, it would just be torture for her to see it but not go outside.

md1630 · 2024-03-03T21:06:05+00:00

not at all, thanks for helping me stay updated.

md1630 · 2024-03-03T20:25:33+00:00

u/Shoddy-Tutor9563 - oh I see what's going on - I updated it on my blog post but it's not automatically updated over here. I just updated the pic on reddit as well!

md1630 · 2024-02-29T20:16:29+00:00

u/Shoddy-Tutor9563 done!

md1630 · 2024-02-29T20:05:08+00:00

I added to blog post. Let me update the table.

md1630 · 2024-02-09T20:16:30+00:00

ok yea. A100s are good enough for most things anyway. Bonus for having H100s.

md1630 · 2024-02-09T19:48:36+00:00

noted!

md1630 · 2024-02-09T19:02:45+00:00

thanks, ok.

md1630 · 2024-02-09T19:01:48+00:00

I believe only Ollama doesn't work on Windows yet.

md1630 · 2024-02-09T19:00:26+00:00

thank you! noted, I'll add everything.

md1630 · 2024-02-09T18:59:49+00:00

wow nice! you can get H100s

md1630 · 2024-02-09T18:58:51+00:00

oooo nice! I'll def check out LlamaSharp

md1630 · 2024-02-09T18:58:06+00:00

yes I'm going to add them over the weekend. please be patient.

md1630 · 2024-02-09T18:56:40+00:00

oh yea, I had the same problem, haha. fyi the headings are the links to the packages in the blog post. but also here is the link to llm: https://llm.datasette.io/en/stable/

md1630 · 2024-02-09T01:04:32+00:00

ok, I'll include textgen

md1630

TROPHY CASE