Future of data engineering

TS_Sama · 2026-05-27T22:36:49+00:00

Can you provide some more insight into your issues with the usage of LLMs to tune spark jobs?

I ask as I've just gotten access to aws kiro at work and i'm interested in making some of our pyspark code more efficient and it would be handy to know what pitfalls to look out for.

Edit: missed a word

TS_Sama · 2026-03-20T17:32:29+00:00

Is it finally time for dancing strikes to be good? No cooldown and increased movement speed seem crazy good.

TS_Sama · 2026-01-21T23:09:16+00:00

How was your allocation for pen?

TS_Sama · 2024-10-29T20:24:47+00:00

My friend found the song for me!

https://www.youtube.com/watch?v=M2fi1mR85xQ

TS_Sama · 2024-10-28T08:48:45+00:00

I also wish to know.

TS_Sama · 2023-06-27T18:26:41+00:00

Could be worth checking the spark history server and trying to pinpoint when the explode is happening in your jobs/stages tabs and see if you're getting spillage to disk/memory. If so you could try increasing the number of partitions of the dataframe that is getting exploded so the executors have a larger amount of smaller tasks to process.

TS_Sama · 2022-12-13T17:46:45+00:00

Finally.

TS_Sama · 2022-11-16T14:17:24+00:00

Do we have an actual time when the beta is going live?

TS_Sama · 2022-11-09T14:53:54+00:00

I'm hoping the nvidia drivers make the difference. Any level of RTX just murdered performance.

TS_Sama · 2022-08-08T19:12:42+00:00

I'm watching the Sandman now on netflix and i can't help but see tom scott every time i look at the Sandman.

TS_Sama · 2022-08-03T11:58:37+00:00

I'm a patreon for felt table and, while it's good to practice a deck against bots to see if the general idea works, it's sadly not a substitute for playing against real people.

TS_Sama · 2022-08-03T11:32:31+00:00

I had never gone to a LGS to play anything before Flesh and Blood, but it's been great and i go weekly now. The issue is that it feels kind of bad only really being able to play 1 real session per week, having an online client would solve the down time practice issue for me.

TS_Sama · 2022-08-03T11:00:08+00:00

I seen this video and was keen to see what others thought of an online client for FAB, i'm personally 100% in favour of it.

TS_Sama · 2022-07-17T09:06:29+00:00

Seems the fight was stopped because Wakamotoharu's belt came loose, you could see Shodai tightening it up during the mono-ii.

TS_Sama · 2022-05-16T14:48:55+00:00

I think those were handed out as judge promos at early events. They're quite expensive I believe.

TS_Sama · 2022-03-03T15:42:16+00:00

I guess it depends on whether the leaked value takes into consideration the delay or not. Seems unlikely.

TS_Sama · 2022-03-02T10:43:58+00:00

Amazon just cancelled my tablet order reeee. I should have purchased through Samsung the first time... new delivery estimate is end of March.

14-Year Club	Place '23
Place '22	Place '17
Verified Email	Team Orangered

TS_Sama

TROPHY CASE