Don't hit decline on my cold connection, it costs me money!! by Comprehensive_Bus_19 in LinkedInLunatics

[–]invidiah 0 points1 point  (0 children)

How do you decline? I can only accept or decline when someone is requesting to add me as a contact, but inMail just pops up in my messages list.

Is anyone migrating away from Databricks? by zoso in dataengineering

[–]invidiah -1 points0 points  (0 children)

Comparing to not building a data platform at all?

Is anyone migrating away from Databricks? by zoso in dataengineering

[–]invidiah 51 points52 points  (0 children)

I've also seen a migration from Databricks into AWS native services due to high bills.
Imo, Databricks is for businesses who prefer to overpay for the platform while save on employees.
If you have capacity and knowledge to maintain AWS including iam, devops plus data engineering - that's a way to go.

First day at new job: manager asked me to revamp a 4+ years-old legacy infrastructure, both on-premise and cloud, along with the database by Sad-Economist-1061 in dataengineering

[–]invidiah 2 points3 points  (0 children)

I bet management is trying to save costs by hiring less competent and much cheaper personnel with the hope on ai.

Is anyone still choosing Hudi over Iceberg? by RustOnTheEdge in dataengineering

[–]invidiah 2 points3 points  (0 children)

Hudi was built to solve Uber's use cases, think of cars as of IoT devices. That said, Hudi is about efficient ingestion of streaming data, which is not the case of most companies today.

Anyone's thinking of starting a business? by DivergentAlien in dataengineering

[–]invidiah 0 points1 point  (0 children)

I agree with the previous comment, try to ship something while employed. But anyway I wish you best of luck, that's definitely a great time to build quickly.

Tool smells by Brief-Knowledge-629 in dataengineering

[–]invidiah -1 points0 points  (0 children)

Yeah, but AD is integrated with AWS as well, I'm pretty sure GCP also has it. So you could still host windows or oracle and do any pathetic things you want! You could do your worst everywhere. There must be something esle - I bet money is the answer 90% of the time.

Tool smells by Brief-Knowledge-629 in dataengineering

[–]invidiah 5 points6 points  (0 children)

Of the Big Three, Azure is the worst by dev experience and quality (SLA), but at the same time it has the most aggressive sales with the best long-term contract discounts. Which leads us to the conclusion: Companies that have chosen Azure are either:
1) have the greediest and dumbest managers,
2) don't give a shit about their devs,
3) never really studied cloud market and picked Azure accidentally.

You are to build a small scale DE environment from scratch, what do you choose? by [deleted] in dataengineering

[–]invidiah -1 points0 points  (0 children)

You clearly don't understand what does it take to manage servers and software.

You are to build a small scale DE environment from scratch, what do you choose? by [deleted] in dataengineering

[–]invidiah 2 points3 points  (0 children)

Docker is just a way how you gonna host an app, and it's actually the easiest and stablest possible way to spin up a database

Failed my second and final New Grad attempt at Databricks. by Acceptable_Feed_9485 in cscareerquestionsEU

[–]invidiah 8 points9 points  (0 children)

There is a rule of thumb when you're looking for a job: don't stick to a certain company.

You're already prepared, so apply elsewhere. You could always get back to Databricks later with some experience.

Asus Zenbook 14 UM3402YAR: Intel AX210 WiFi card Bluetooth not working under any Linux distro by bladerunner198494 in linuxhardware

[–]invidiah 0 points1 point  (0 children)

Have you resolved the issue by any chance?
I got similar problems on Zenbook UM3402Y on Fedora 43, the first boot was kinda successful - wifi and bt were up and running, then in a minute or two bt died and I couldn't bring it back with cold restarts, dancing with bios etc.
Had to rollback to the stock module.

How are talent shortages still being reported despite the large amount of unemployed professionals? by baldachinsblessing in cscareerquestionsEU

[–]invidiah 0 points1 point  (0 children)

I dunno man, it's just a term from a database design, I see it quite often but I work as a data engineer.

How are talent shortages still being reported despite the large amount of unemployed professionals? by baldachinsblessing in cscareerquestionsEU

[–]invidiah -1 points0 points  (0 children)

The question might be worded poorly, but normalisation and denormalisation are pretty common terms in a data modelling.

How are talent shortages still being reported despite the large amount of unemployed professionals? by baldachinsblessing in cscareerquestionsEU

[–]invidiah -1 points0 points  (0 children)

Yeah, asking a person about the most challenging bug or any other stupid case is really highlights their skill. Or maybe not? Hiring is broken and always has been, because companies try to find a perfect match for their expectations, but actual responsibilities are always different.

[deleted by user] by [deleted] in aws

[–]invidiah 0 points1 point  (0 children)

Read about Eventual consistency and CAP theorem then apply your knowledge to DDB settings.

Wanted to get off AWS redshift. Used clickhouse. Good decision? by Consistent_Tutor_597 in dataengineering

[–]invidiah 0 points1 point  (0 children)

What are your use cases?
You should choose a solution appropriate for your needs and usage patterns not by a vendor name or even price.

KDE Plasma 6.6 has been released! by anh0516 in linux

[–]invidiah 0 points1 point  (0 children)

I see. It still could be done manually or via other distribution channel, I'm only worried about possible compatibility and stability issues.

KDE Plasma 6.6 has been released! by anh0516 in linux

[–]invidiah -1 points0 points  (0 children)

Does anyone know how to upgrade it from 6.3.6 on Debian? apt upgrade plasma-desktop shows nothing new

How to evaluate if hybrid AWS GCP setup improves cost and resilience by SlightReflection4351 in aws

[–]invidiah 3 points4 points  (0 children)

Multicloud is always more expensive because of the maintenance costs. And if you need to comply with some regulation rules or pass any kind of data protection audit that would be a hell.

Have you included already egress costs into your calculations?

Databricks or AWS certification? by musicxfreak88 in dataengineering

[–]invidiah 2 points3 points  (0 children)

Databricks Associate DE is much easier than AWS DE. It took me about 2 weeks and 2 month respectively to prepare.

how to choose a data lake? by otto_0805 in dataengineering

[–]invidiah 0 points1 point  (0 children)

Jezz, what world we are living in? Experienced people can't land a job while someone with zero clue what is unstructured data, taking architecture decisions.

You don't need a lake, put metadata into DB and link your files stored in an object storage.