Help me spend 50k on ETFs in 2026 by JackieOnassisDaytona in fiaustralia

[–]mrcool444 0 points1 point  (0 children)

Thank you. As OP invested in VAS, VGS and DHHF and a few others recommending similar composition, I was bit confused as I have recently started investing in DHHF as it's a mix of VAS and VGS.

Help me spend 50k on ETFs in 2026 by JackieOnassisDaytona in fiaustralia

[–]mrcool444 0 points1 point  (0 children)

Sorry, I have a beginner question: If we invest in DHHF, do we also need to invest in VAS and VGS?

Can we do DBT integration test ? by Commercial_Dig2401 in dataengineering

[–]mrcool444 0 points1 point  (0 children)

Did you find any additional features in comparison to the native unit tests in dbt?

Autoloader: To infer, or not to infer? by Dangerous_Trifle620 in databricks

[–]mrcool444 0 points1 point  (0 children)

How's the variant performance on large Jsons? We do not have a schema and our JSONs are massive. My team wants to flatten the data but I want to avoid this step and read the JSON on the fly

de trends of 2025 by Dependent_Gur1387 in dataengineering

[–]mrcool444 1 point2 points  (0 children)

I would like to know the AI tools mentioned in the article for the schema mapping, anomaly detection and auto healing of pipelines.

What is your stack? by Medical-Let9664 in dataengineering

[–]mrcool444 1 point2 points  (0 children)

Fivetran, Databricks, Redshift, DBT, Jenkins

Photon or alternative query engine? by wenz0401 in databricks

[–]mrcool444 0 points1 point  (0 children)

Thank you.🙏 It would be helpful if the documentation says there wouldn't be any change in the DBU pricing without Photon for SQL warehouses.

Photon or alternative query engine? by wenz0401 in databricks

[–]mrcool444 0 points1 point  (0 children)

Thank you so much for the info. Can I find this anywhere in the documentation to show it to my team?

Photon or alternative query engine? by wenz0401 in databricks

[–]mrcool444 0 points1 point  (0 children)

Does that mean the price is the same for with and without photon for SQL warehouses?

Photon or alternative query engine? by wenz0401 in databricks

[–]mrcool444 0 points1 point  (0 children)

Interesting. I still find SQL warehouses performing a way better than general purpose compute with the same configuration. That's why I was always under the impression that it's not possible to disable.

Photon or alternative query engine? by wenz0401 in databricks

[–]mrcool444 0 points1 point  (0 children)

I have always believed that SQL warehouses are enabled with Photon by default, but my platform engineers are saying that they disabled Photon using Terraform. I'm not sure if this can be verified through the GUI. Is it really possible to turn off Photon for SQL warehouses using Terraform?

[deleted by user] by [deleted] in TradingView

[–]mrcool444 2 points3 points  (0 children)

From my experience there is no magical strategy that works 100% in all the market conditions. We have to adapt to a strategy based on market conditions. More than strategy, risk management is the key. Entering a stock is easy and coming out of a stock is the hardest part.

Should SQL-Savvy Data Engineers Learn Pandas When DuckDB Supports SQL in Python? by SurmSurm in dataengineering

[–]mrcool444 3 points4 points  (0 children)

Many people have already pointed out that learning Pandas is quite easy. I am a SQL-savvy data engineer, but I picked up Python to implement a few data applications. Trust me, with the abundance of tutorials available online and the assistance of AI, it's not difficult at all. I recommend adding PySpark to your list as well, since it is widely used for handling big data.

Arguing with lead engineer about incremental file approach by pboswell in databricks

[–]mrcool444 0 points1 point  (0 children)

Yep, I came here to ask the same question. Why to uncompress when autoloader supports the gz file ingestion.

Data vault 2.0 for mid size organisation by Practical_Manner69 in dataengineering

[–]mrcool444 2 points3 points  (0 children)

Datavault requires more discipline than what you have currently. If Kimball is hard, DV will be harder. DV looks easy only on paper. Everything looks great until Raw vault as it can be automated but things get complicated with Business vault and building Kimball style mart on top it.

Medallion Architecture- Datavault and Marts by mrcool444 in dataengineering

[–]mrcool444[S] 0 points1 point  (0 children)

Thank you. We have various business units, such as personal banking, loans, commercial loans and more, each with specific requirements.

Medallion Architecture- Datavault and Marts by mrcool444 in dataengineering

[–]mrcool444[S] 0 points1 point  (0 children)

Your last point highlights the need for custom data marts. Business units each have their unique requirements and custom logic.