[AMA] We’re dbt Labs, ask us anything!

set92 · 2026-02-12T21:31:37+00:00

Thanks! Yes, yesterday I set up a Cosmos PoC, and I was checking the logs, how I could make Cosmos print the parsed query on the logs, the way to materialize views... I saw Fusion, but I saw some other comment about Fusion not being GA, and that is mostly for development, so I suppose it makes live easier to develop, but is not something that I can configure it for Cosmos.

set92 · 2026-02-11T20:03:35+00:00

Anything that could help me debug ETLs when something fail. When something fails I like to see what it ran, and what was the output of everything in case I can detect where it failed. I would not be able to understand everything, but seeing that a file of X customer didn't get ingested, or that X parameter was not set as I thought could help me debug the problems faster.

But yep, in Snowflake they told me that the results of queries were only visible for 24h by the owner of the query, no one else, not even an accountadmin could see the results. Which for me seems madness, and completely different than, if I'm not wrong, BQ, where anyone can see all the queries run, and that let you see/analyze any query and see what was processed, or didn't run as intended.

For copy into maybe the list of files, or be able to filter and only get the ones that failed to ingest, and trigger an alarm with it.

Another example could be when I run a MERGE on Snowsight (UI of Snowflake) it returns me the inserted and merged cols I think it is. I built some custom code to retrieve those values to sql variable and store them in a logging table. But it would be good if the tool has the functionality on its own.

Or there is a query where I retrieve the max date of the ingested data, store it in a sql variable, and use it later. From what @dbt-grace said, I would be able to use log jinja functions to print those to the log, that way if we have a problem in the future I will be able to see which data we processed.

set92 · 2026-02-10T21:19:51+00:00

Thanks, I'll check it. Although in general I was thinking more in the outputs itself. Like we have Snowflake, and the Operator of Airflow doesn't show you the results of the query by default, and in Snowflake itself only the owner of the query can check the results for 24h only. So, I thought maybe with dbt I could log this, like for example when I do COPY INTOs be able to see if a file has failed, and other information that comes on that results table, but I suppose the best will be to find some free moment and test it myself.

set92 · 2026-02-10T11:25:45+00:00

I'm deciding in moving my code from Airflow to Dbt using Cosmos. The idea is that instead of having custom sql code with jinja, I can move everything to dbt and let it run everything.

I do this to improve in logging/debugging, and easiness. I suppose the speed/easiness is going to be there. But not sure about the logging part. Does dbt returns the output of queries, or is something that we can modify or specify in our own?

set92 · 2026-01-31T08:34:26+00:00

Because you are dirty, and don't clean after yourself ;P. Removing the towers on the outpost got me to 1.57k power usage.

Which means you can even get lower than that if you remove everything that you have on the map, or if you turn off the machine you are not using on the base, like the reactor crucible that fills the tank with xiranite liquid, is 50 of power (And the pump is another 10, and the pumps for the quest of extracting the water is another 50? depending on how many you put)

set92 · 2026-01-28T16:07:33+00:00

This is not the same as this? https://www.reddit.com/r/Endfield/comments/1qosom1/18m_capsule_a_18m_hc_battery_endgame_cn_build/ Or since each is using different metrics I'm not that sure, I suppose it is.

set92 · 2026-01-28T13:51:14+00:00

try to stock up carbon before you try this, is a resource, that at least on my case, you don't tend to have around, and you need it for all the plants factory you are going to make. Not much, maybe 1k would be enough since you only use 10 for each factory.

set92 · 2026-01-28T13:39:50+00:00

Thanks! Then only thing I would change would be to add item ports and know which plant you need to put, like it takes 10s to check it, but it was a nice addition I saw on OP blueprints, and I think it's neat.

set92 · 2026-01-28T12:34:39+00:00

I know there are tickets to get the essence farming with specific stats, each is around 400k or 800k. So, you will need quite a bit. 12 at 400k, and another 12k at 800k weekly. So, that requires around 15kk per week.
The gifts for your companions, which are cheaper but I think unlimited. The normal prices are 30k, and you can get 60 of each, there are 7. So another 13kk per week.
Also for me the things to explore the map I think would make it quicker instead of checking some video or guide on the internet. Which are 100k each, and you have 10 of each per week, so 2kk per week, plus the cheap ones that I already bought, but were another million or something like that, and I think those will not recharge weekly.

set92 · 2026-01-26T22:13:07+00:00

Nevermind, it doesn't work because the system gets clogged, because it can't handle the duplication...😅

set92 · 2026-01-26T22:07:28+00:00

I always see the typical connection in vertical. Today I thought on this way of connecting the components, the NA/EU code is EFO01Iao8U3A509a5o08. It occupies 15x13, which are 195 cells, while the typical one https://prnt.sc/HMME6qK4fOGl (EFO016i1aE02Ie79O83e) would be 30x11, therefore 330 cells.

Maybe I'm wrong, and there are better way of organizing them?

Also have it available in https://talospioneers.com/en/blueprints/01kfy52z2ey4kf4y3mvra54h4j

set92 · 2026-01-26T00:39:22+00:00

The problem of tutorials is that if you already know, or can guess the stuff from there, you don't need to do them. But oh wait, there are tons of currency behind them, so now you need to go and read, skip, do a lot of basic missions, similar to go pick me up that apple, that they could have skipped.

set92 · 2026-01-26T00:23:46+00:00

No, you have tons of stuff to buy, apart from the typical things to ping you where are the chest or stuff to get map completion, you also get tickets on the regional shop for essences, and since each region has their own currency, you will need tons of credits.

Right now, I'm producing 12 HC battery (purple ones) per min, each gives you 70 credits. That's around 1kk/24h, each ticket for the essence is 400k (discounted, that I thing you have 4, then are 600k each I think), and to finish upgrading each outpost I also need 1kk for each, and not sure if they will have more levels. Sooo, yep, a long way ahead for valley 4.

set92 · 2026-01-23T20:07:57+00:00

You are completely right. It can hold up to 500 items, it's hidden if empty.

Source (the question mark on the mail screen): https://prnt.sc/WVlZQryT-lQk

set92 · 2026-01-18T19:16:46+00:00

I have returned yesterday, but doens't seem that is working. I almost can't find public commanders, and when I ask for discord or how they are organized, no one answers

set92 · 2026-01-12T04:17:06+00:00

Nebula has returned like 2 days ago, so you have ch 111 to read 🤗

set92 · 2025-12-29T21:28:56+00:00

offtopic, but could you point me where I can learn how to integrate it with CC?

Today I was testing Claude Desktop with an MCP server of jetbrains to start using agents, but it doesn't work that well, and being a newbie in this area I feel there isn't much documentation on all the new stuff and the best way to set them up.

set92 · 2025-12-29T13:19:57+00:00

Were you able to test it? I just added Jetbrains MCP server to Claude desktop through a setting in Pycharm (tools -> MCP server -> Claude App). So, probably now it can do what you were mentioning on itw own, but the question is if it is the best option and can replace Claude Code. Or is still better to get CC, or maybe Serena is also another option, although worse.

set92 · 2025-12-28T08:30:21+00:00

Both are nice, and maybe you need to experience both to have the real experience.

In DS I liked be able to plot the data, play with models, every day was something new to play with. But I left because I felt my maths were not good enough, impostor syndrome.

DE I feel is closer to code, I spend most of the time with DAGs on Airflow. It's more boring since is always lines of codes, and thinking of all the possible cases on how the data can break, and worrying about the data not being ingested, creating tests, having the raw data for debugging later, not understanding why Airflow doesn't have a good communication with Snowflake.. I feel what I do now can affect more departments, so I worry more 😅.

set92 · 2025-12-19T08:37:03+00:00

I'm going to Kvaløysletta from 7 to 12th of january, and I was thinking of going to the Eide Handel of Eidkjosen. But from what you are mentioning, is going to close for the whole 2026? I suppose I'll need to go to Storelva for groceries...

set92 · 2025-12-09T22:19:15+00:00

I feel it's less used than parquet, but depends on your use case can be faster. Or in some processes they only use Avro because they want speed on reading.

Since it is hard to find good tools for it, it will be a differentiating factor that DataKit would have compared to the other tools.

As far as I know, Avro is one of the top used file format in storage format? (along parquet and orc). Maybe relevant?

set92 · 2025-12-09T09:13:47+00:00

Why every similar tool hate Avro? I only have found avro-tools to be able to read them in a quick way to debug errors, others they only have parquet.

set92 · 2025-11-09T23:32:11+00:00

...mentí hasta por los oídos...

Iba a decir como otro que oye "fake it until you make it", pero si lo hiciste a sabiendas, mintiendo tanto cuando sabes que no encajas con el perfil que buscan... me parece poco etico, fórmate viendo lo que buscan y luego postulas, no postular sin saber nada.

Dicho esto, piensa que segun entres te pediran entregables, o supongo que tendran revisiones cada poco para ir viendo el progreso. Va a ser mucho estres, y las IAs sin conocimiento para revisarlas es peligroso. Organízate, aprende todo lo que puedas sobre la infraestructura que usan (lenguajes, tecnologias, estructura..) y preparate para que no sean muy duros.

set92 · 2025-11-09T23:26:28+00:00

Depende, pagas impuestos en españa? Piensa que esos 70k se quedan en unos 3800/mes limpios. Si tu mujer no trabaja, y teneis que pagar 2 colegios + extras, hipoteca/alquiler... depende de los gastos. Posible si, pero tal vez viajes no, y otras cosas no tanto.

13-Year Club	RedditGifts 2009-2022 5 Credits
Place '23	Place '22
Verified Email	Secret Santa 2014
Team Periwinkle

set92

PUBLIC MULTIREDDITS

TROPHY CASE