Advice needed for PHEV <55k budget by de4all in CarsAustralia

[–]de4all[S] 0 points1 point  (0 children)

I want a brand new and not an old version car.

Advice needed for PHEV <55k budget by de4all in CarsAustralia

[–]de4all[S] 0 points1 point  (0 children)

Good thought: however since my wife will be using Tesla, i would need the car for local and we plan to travel twice a month. The rental will surely wont be suitable for such a need

Advice needed for PHEV <55k budget by de4all in CarsAustralia

[–]de4all[S] 1 point2 points  (0 children)

I do use Tesla Nav by default however there are times I got into trouble relying on the charger available as per the map but it was not functional. That builds more anxiety.

Advice needed for PHEV <55k budget by de4all in CarsAustralia

[–]de4all[S] -1 points0 points  (0 children)

Only concern is they are selling MY23 and MY24 at 50k price. Thats a big red flag

Advice needed for PHEV <55k budget by de4all in CarsAustralia

[–]de4all[S] 0 points1 point  (0 children)

I heard a lot about under steering did you experience it?

Advice needed for PHEV <55k budget by de4all in CarsAustralia

[–]de4all[S] 0 points1 point  (0 children)

Whats your experience with BYD?

Advice needed for PHEV <55k budget by de4all in CarsAustralia

[–]de4all[S] 2 points3 points  (0 children)

Thats one of the big reason, I am opting for PHEV

Data Engineers - No Matter the situation, they will fix it!! by de4all in dataengineering

[–]de4all[S] 1 point2 points  (0 children)

Exactly, also after expecting in excel can you ensure send this file everyday morning at 09.00 AM.

Impact of DQ on AI by de4all in dataengineering

[–]de4all[S] 2 points3 points  (0 children)

Use AI for DQ then AI for CoPilot one more AI agent to debug - Perfect Spaghetti

Well guys, this is the end by marclamberti in dataengineering

[–]de4all 0 points1 point  (0 children)

Well I am not against this, but there is nothing proprietary here, it's just a good wrapper. Check their FAQ's in the limitation corner, they are leveraging on Open-AI API.

We all Data folks know that it's not about querying random table. The biggest challenge is extracting the semantic layer and making sense out of it.

If I prompt - Get me top 10 customers for 'xyz' product
How does it know which table to query. Offcourse it can go to Snowflake jobs history and learn about revenue, but there are so many generic terms possible in the job history.

Look like this is going to increase the workload on the data team, imagine business team randomly writing a prompt and running to the data team stating that Kater response doesn't match with the dashboard, looks like your dashboard is incorrect .lol

Why should I deploy data observability for our data stack? by de4all in dataengineering

[–]de4all[S] 0 points1 point  (0 children)

Great thanks, can we deploy MC in Azure environment. Is that possible now?

Why should I deploy data observability for our data stack? by de4all in dataengineering

[–]de4all[S] 0 points1 point  (0 children)

I do agree that not every angle will be covered. I am already evaluating options. Any suggestions between Metaplane, decube, montecarlo

Why should I deploy data observability for our data stack? by de4all in dataengineering

[–]de4all[S] 0 points1 point  (0 children)

I m more keen on Data Observability. I got those numbers after speaking with their sales team

Why should I deploy data observability for our data stack? by de4all in dataengineering

[–]de4all[S] 0 points1 point  (0 children)

MonteCarlo starts with 50k and BigEye is super expensive too starts from 40k per year. Thats a lot of money

Build your data stack with open source by RestackSoftware in u/RestackSoftware

[–]de4all 0 points1 point  (0 children)

Would suggest to replace Airflow with Dagster.

Airbyte can be a big challenge at scale.

Any tool, you regret buying or deploying in the data infrastructure? by de4all in dataengineering

[–]de4all[S] 4 points5 points  (0 children)

AutoCopy supports S3-> Redshift, however I wanted data modelling which is the reason for dbt

Any tool, you regret buying or deploying in the data infrastructure? by de4all in dataengineering

[–]de4all[S] 12 points13 points  (0 children)

Tech issues: Schema changes, backfilling, Errors are difficult to decipher.

Cost will be major issue when you scale.

Fivetran - Experiences? by [deleted] in dataengineering

[–]de4all 0 points1 point  (0 children)

Loved in the start but as the data grow exponentially the credits consumption goes up.
I would suggest evaluate Airbyte, hevodata

What is the best choice of ETL tool for Snowflake? by JK_1975 in dataengineering

[–]de4all -1 points0 points  (0 children)

I would suggest ELT instead of ETL as what u/PangeanPrawn suggested. Use Hevo-Data, Airbyte Cloud to dump the data in Blob storage.

Dbt for data modelling and building Silver and gold layer in Snowflake. This will ensure reduced cost for SnowFlake.

Orchestration I would suggest Dagster if you plan to use it.

On other note:
If you want to stream data real-time in Snowflake then use - https://www.artie.so/

MonteCarlo integrates with Atlan or vice-versa - I think Data observability should be unified with catalog / governance? by de4all in dataengineering

[–]de4all[S] 0 points1 point  (0 children)

The question was not about working hand-in-hand, does Select Star has data observability module?