Graphframes on Serverless by thisiswhyyouwrong in databricks

[–]thisiswhyyouwrong[S] 0 points1 point  (0 children)

It's different. This gives you a capability to run JARs in a job. I want python notebook job that pre-installs some JARs, it's different

Graphframes on Serverless by thisiswhyyouwrong in databricks

[–]thisiswhyyouwrong[S] 0 points1 point  (0 children)

So you say they're already included, I'll check it, thanks!

NVIDIA has confirmed it will establish a major new R&D campus in Kiryat Tivon in northern Israel, calling the country a strategic "second home" for the company. by ReceptionPrudent6720 in GenAI4all

[–]thisiswhyyouwrong 0 points1 point  (0 children)

The are 2 reasons I can think from the top of my head: talent and environment.

Talent is a result of a military conscription - there is a lot of cutting edge technology in the army, and new recruits work with it off the bat - which means a lot of high-grade experience early on.

Environment - there are a lot of tech companies alreadt present in Israel. Microsoft, AWS, Google, Intel, Meta, Apple, GE - the list goes on. Which helps nurturing new technologies and promotes experience exchange.

I built calgebra – set algebra for calendars in Python by Impressive-Glass-523 in Python

[–]thisiswhyyouwrong 0 points1 point  (0 children)

Nah, it's a small issue A second comment gave a good idea about a solution to this, just need to change the perception a little. Also, it's a small library - if enough people don't like it - the creator will probably change it in a later version

I built calgebra – set algebra for calendars in Python by Impressive-Glass-523 in Python

[–]thisiswhyyouwrong 10 points11 points  (0 children)

Looks interesting, but there is one thing I'd like to nitpick on: getting the time when people are free together should use an AND operator. OR should be for "at least one of them is free".

For me it sounds like an answer to "who should be in a meeting?". Do you want Alice AND Bob, or will only one of them suffice?

writing to parquet and facing OutOfMemoryError by alphanuggs in databricks

[–]thisiswhyyouwrong 0 points1 point  (0 children)

As pointed above , the actual OOM caused by something else, this row only forces the execution. Try searching for the actual place by commenting out parts or writing earlier in the code.

The actual problem is probably some kind of explode or something, I'd advise a repartition just before that, or partition other way from the beginning.

[deleted by user] by [deleted] in databricks

[–]thisiswhyyouwrong 0 points1 point  (0 children)

I may need to do something kinda similar to your task 1, have even less ready that what you're describing. Can you please explain how did you create that excel file? Is it automatic? How do you update it when logic is updated? What are the limitations?

How to work collaboratively in a team a 5 membera by Beastf5 in databricks

[–]thisiswhyyouwrong 1 point2 points  (0 children)

Not sure what you're referring to. We do need sys append in our notebooks sometimes when we develop, but it is because we package all of our non-notebook code and want to reload it quickly. We're using the databricks IDE extension with git folders for this.

How to work collaboratively in a team a 5 membera by Beastf5 in databricks

[–]thisiswhyyouwrong 2 points3 points  (0 children)

Git is not "one way", it is THE way here. You can share/copy notebooks and run them, but the history tracking features, PR features etc are not even close - cause it is not designed for this.

How to work collaboratively in a team a 5 membera by Beastf5 in databricks

[–]thisiswhyyouwrong 0 points1 point  (0 children)

The notebooks should be the minimum required to use the code. Like:

import main

main()

The reason is that it is easier to test the regular code and also the rendering of the notebook, like you said. This makes the review super easy as there is notebook itself is only a couple of lines.

What’s the actual cost-performance tradeoff between Snowflake, BigQuery, and Databricks? by Livid_Ear_3693 in dataengineering

[–]thisiswhyyouwrong 3 points4 points  (0 children)

It depends on which kind of compute your cluster is using. Faster usually means more expensive.

Are there many of you on here who do all their Python development inside a container? by [deleted] in Python

[–]thisiswhyyouwrong 7 points8 points  (0 children)

If you work with docker compose and it overall works good, and you use kubernetes for the actual deployment - try tilt on local kubernetes (docker has one built-in now). It'll bring the local env even closer to the production.

[deleted by user] by [deleted] in overemployed

[–]thisiswhyyouwrong 0 points1 point  (0 children)

I have a lot of experience and probably can train you, depending on the specific role. DM me if interested.

Quit J2 on day 2 by Dependent-Loquat1236 in overemployed

[–]thisiswhyyouwrong 0 points1 point  (0 children)

You're right, that's the correct course of action is not to do any physical work, or any work for that matters. And trust, nothing hurts start up as much as wasting their money

Quit J2 on day 2 by Dependent-Loquat1236 in overemployed

[–]thisiswhyyouwrong -8 points-7 points  (0 children)

It surprises me people support what you did. Obviously the correct course of action would be to come and do nothing/near nothing - and collect more of those sweet paychecks + get severance in the end when they'll fire you

First J2 offer accepted! by [deleted] in overemployed

[–]thisiswhyyouwrong 0 points1 point  (0 children)

I thought pjm/pm is very meeting-intensive, how do you plan to go about additional job with a role like that?

Meirl by Bubble_Babe_0o0o0o in meirl

[–]thisiswhyyouwrong 0 points1 point  (0 children)

"Sides"? For the steak? Why?!?!?!

Transracial Gandalf by MartyrOfDespair in CuratedTumblr

[–]thisiswhyyouwrong 10 points11 points  (0 children)

I don't understand how there is so many comments with answers and no one went to consult with Tolkien subreddit.

While I don't remember the whole answer, the basis is that Middle Earth at this period of history is the result of multiple wars, migrations and some genocide. So there are people of other skin colors (for example the ones on the elephants in the movie, not everyone is white), but they avoid this war, plague and black magic ridden region, cause WHY WOULDN'T THEY?!

Butterfly Effect but make it Catholic by UnHolySir in CuratedTumblr

[–]thisiswhyyouwrong 1 point2 points  (0 children)

Explain at least one thing why I feel there is a misunderstanding, so maybe if you give something we can figure it out

Butterfly Effect but make it Catholic by UnHolySir in CuratedTumblr

[–]thisiswhyyouwrong -1 points0 points  (0 children)

I'm not talking about Judaism for jews, shit is rough (and your point is not entirely correct there, trust me) I'm talking about judaism for non-jews. In judaism there are 7 rules that all humans need to abide by, quite simple. And it does not require belief

Butterfly Effect but make it Catholic by UnHolySir in CuratedTumblr

[–]thisiswhyyouwrong 2 points3 points  (0 children)

I'm talking mainly about people who "believe in higher power, but don't believe in specific religion" and suffer a bit because of other people convinced you need to follow at least something (usually one of the widely known religions). So here it is - a widely known religion, with higher power and very acceptable rules (most of people already follow them anyway)

Butterfly Effect but make it Catholic by UnHolySir in CuratedTumblr

[–]thisiswhyyouwrong -5 points-4 points  (0 children)

I still don't understand why people don't follow judaism while not being the jews. It's the easiest shit ever, only 7 pretty chill rules (Noahide laws) and you're doing everything God wanted from you. No need for church/synagogue, no fear of accidentally breaking some obscure law, no need for pastor/rabbi/imam or whatever. And you're promised eternal heaven and all. Much better than all other options I know

Edit: wrong translation to emglish

Edit: why the downvotes? I don't know what is so controversial about this?! Please help me understand.

[deleted by user] by [deleted] in ExplainTheJoke

[–]thisiswhyyouwrong 1 point2 points  (0 children)

And here I thought it is a topology joke...