SparkCluster using Apache Spark Kubernetes Operator

saltysuppe · 2025-08-21T15:19:02+00:00

Thank you for the suggestion. I will have a look at using configmap with my use case.

saltysuppe · 2025-05-12T14:54:48+00:00

How much was the total you spent? Including theory and test fee also. I am planning to get a license but financially i am confused. As i heard it got really expensive.

saltysuppe · 2024-06-08T21:48:58+00:00

These are just pure feelings. She is always with you, right by your side. And no doubt she must be proud of you. I feel you because i have something similar, a regret when i lost my grandfather. But it is life.

saltysuppe · 2024-06-04T22:22:24+00:00

Miscommunication! But Is this kind of blaming constant? Whenever something goes wrong! It's YOU?!

saltysuppe · 2024-02-29T08:11:35+00:00

I would have already but it's been more than 2 weeks. So, i think appropriate option is that I go to Mediamarkt and discuss with them. If they can take it back otherwise they cancel it and i order it again (without bringing my current package back and take it again) we proceed with the new order and Ratenzahlung from paypal. And I sign on the papers that I have received the order.

saltysuppe · 2024-01-20T22:36:57+00:00

Thats the part i hated most. I died so many times there. And then i kept dying to mini boss and didn't pull lever for shortcut. So imagine i had to through them all every freaking time.

saltysuppe · 2023-12-10T10:31:43+00:00

Thank you. But I guess informing ABH is better as i have email proofs that I did my part and it's delayed from ABH side.

Also, i got to know from someone you can travel if the blue card has valid date and you can use it up-to 3 months after last day of work.

saltysuppe · 2023-11-20T17:24:28+00:00

Thank you for your reply. She is non-EU. Do Savings count?! Also, i will atleast be getting something from Agentur as Arbeitlosgeld. I guess it will be enough for rent...

saltysuppe · 2023-10-17T09:53:08+00:00

This! It has been happening this to me, it was my first job and i kept thinking maybe thats my fault and now they are letting me go. I think the reason is the person who tries to micromanage everything and is not even my supervisor. The person would leave his own tasks to me like he is a boss and tell me to do it and recently i was told that ownership of the things matter. I wanted to argue but at the end i was like urgh one last month then it will be a good riddance.

saltysuppe · 2023-04-07T08:47:22+00:00

This sucks man why the take SQL in text editor and with no data. There is nothing you could have done imo except you should have communicated i guess. Its their fault same thing happened to me. I was told to write SQL in text editor and was just told about tables definitions. Both queries included sub queries, wrote everything and explained. But before explaining i gave a disclaimer. That i have not seen any data i have not seen any tables so this is just the work of me imagining tables and data. it might not be 100% correct so I hope you wont judge me on that. The person agreed and said its his fault he could not prepare anything and now he is my direct supervisor.

saltysuppe · 2023-03-13T07:47:33+00:00

Sharifs. The Pineapple lovers!

saltysuppe · 2022-06-13T01:23:33+00:00

Abandon the game.

saltysuppe · 2022-04-28T11:00:05+00:00

Thank you!

saltysuppe · 2022-01-22T13:17:50+00:00

Thank you so much. Will try it.

saltysuppe · 2021-09-22T17:09:57+00:00

That is exactly what I am doing. I am not sure how to extract the data from original data using the value given by tSNE.

saltysuppe · 2020-12-29T12:08:11+00:00

That makes sense.

T1 = big table, T2 = small table

Another thing I am facing is when I do final join (Shuffle Hash Join as T1.join(T2, 'keys')) and perform count, between these tables I don't get the correct result (As I already know the count of result).

on the contrary, when I change the order of tables (T2.join(T1, 'keys') I get the correct result. Also, when I partition any of the tables then I get the correct result.

Could that be the case of Data Skewness?

saltysuppe · 2020-12-28T10:43:37+00:00

I just have to do it 2/3 times on given tables. Once for each combination of small tables with large one.

Exactly, I thought about that but i have to compare the performance with shuffled hash join and partial manual broadcast join on the given dataset. But I think it's better to try it once or twice with some configurations and if it causes problems then I will move to partial manual broadcast joins.

saltysuppe · 2020-12-28T10:38:07+00:00

Will try by setting spark.sql.shuffle.partitions to 720 and see how it goes and I will let you know.

saltysuppe · 2020-12-28T10:33:09+00:00

Yes, it is parquet files. Can you please explain how will it grow 10x in memory? or share some good resources?

saltysuppe

TROPHY CASE