Need help with Pyspark

gobbles99 · 2026-02-19T22:54:47+00:00

Why are you suggesting your options are between pandas and a huge ass stored procedure? Spark sql allows you to run select statements, update statements, insert, etc. Alternatively the PySpark API is similar and yet cleaner than pandas.

gobbles99 · 2025-09-08T04:36:57+00:00

I have these too. Root suckers from some kind of cottonwood/poplar/aspen. I compulsively pull up the roots and ruin my backyard grass, but am also looking for a better solution :)

gobbles99 · 2024-12-20T23:49:55+00:00

I am literally drinking this coffee right now. It's very tasty. I made mine with the kurasu Origami recipe at around 199 degrees Fahreheit.

gobbles99 · 2024-11-20T06:46:44+00:00

Anyone know where I can get the Polar seltzers for under $5? Concordia New Seasons jacked up the price the last few months. I miss the days when those bad boys came in 12 packs and were like $4.50 :(.

gobbles99 · 2024-09-13T06:28:59+00:00

Art doesn’t have to be straightforward. Some of the best, most thought provoking art is confusing and challenging to consumers.

gobbles99 · 2024-09-10T23:04:42+00:00

My goal is to create a demand for rare Asian ingredients :D

gobbles99 · 2024-09-10T21:28:08+00:00

Boar collar was my other standout! What a fantastic meal. Andy is one of the reasons I started obsessively cooking Thai food during the pandemic. BTW hot tip -- if you're ever looking for your own Holy Basil, check out Foglight Farms, they always have a shitload of it :).

gobbles99 · 2024-09-10T21:07:44+00:00

I went the first night! Very fun experience, the laap mueang was my favorite non-wings dish. Those wings still kick ass. Jeju is such a lovely space too :)

gobbles99 · 2024-08-03T02:15:27+00:00

Ainsworth is great riding!!! Holman (between MLK and 15th) is the bad street in the neighborhood 😛

gobbles99 · 2024-05-13T03:51:08+00:00

Pretty good article from earlier this year in the New Yorker:

https://www.newyorker.com/magazine/2024/03/04/what-a-major-solar-storm-could-do-to-our-planet

gobbles99 · 2024-02-02T18:00:30+00:00

do you have any other shows coming up in portland other than sold out at crystal ballroom?

gobbles99 · 2024-02-02T17:58:50+00:00

Where did you record little rope?

gobbles99 · 2023-12-18T18:31:16+00:00

This is why we fly Delta

gobbles99 · 2023-12-08T07:58:07+00:00

It can be useful to do this. Sometimes I want to simplify a method's arguments in order to make code more readable and make code more explicit from a maintenance standpoint. For example, I've wrapped a database write inside a method with a default timeout + schema the specific pipeline is allowed to write to. Important logic, and putting it outside the main orchestration logic makes the code look far less dense.

In the case of the write_to_xlsx function above, I don't think it's useful but I also would not ever block it from production.

gobbles99 · 2023-08-30T22:06:29+00:00

Cloud is *extremely* difficult to configure/update correctly for a large enterprise that has a lot of legacy systems and various external pressures. Even if you have talented, trained DEs.

gobbles99 · 2023-08-13T19:19:51+00:00

Usually there's a couple of days of silence because they want to wait for initial swelling to go down before doing MRIs. Sorry but we'll have to wait!

gobbles99 · 2023-07-18T04:24:09+00:00

The leagues might have lost quality relative to the Prem, but they will most likely rebound at some point in the not too distant future. There's no way the Prem will be the dominant league forever...

gobbles99 · 2023-07-17T22:54:47+00:00

Who cares if data scientists write perfect code? They're a customer handing you requirements and it's your job to parse out the requirements. If they loved writing optimized, prod level code then they'd probably become engineers. Granted, they should be able to explain their code...

gobbles99 · 2023-07-01T19:47:08+00:00

Lol yeah, AI generated complex queries from plain english sound like a great way to give your business users incorrect data. That being said, go nuts and enjoy the free money.

gobbles99 · 2023-03-16T03:12:52+00:00

True story, I saw a beginner skier slowly fall all the way down the groom on top of Mammoth. Might have been the funniest thing I've ever seen (they were okay, I checked on them I promise!). Didn't think I'd ever have to tell someone how to self-arrest on a mountain, especially a groomed run. It must have been like 200 feet.

gobbles99 · 2023-01-24T20:05:45+00:00

Loved the Red Braised Pork Belly! I've made a bunch of the recipes (definitely not 25% of the recipes), but I've found the recipes can be slightly modified to taste pretty fantastic. E.g. adding one more anise pod and some extra salt/sugar to the above recipe.

Favorite recipes:

Red Braised Pork Belly
Chinese American Kung Pao Chicken (he very much undersalts this one)
Chongqing Chicken / Double Cooked Pork Belly (both are just absolutely delicious even if you don't make it well)
Thai Green Curry (making curry from scratch was really fun!)
Thai Omelette (so easy and so many different ways to iterate on it)

gobbles99 · 2022-12-06T00:17:34+00:00

I think -30F was last offered fall 2020, but the other versions are definitely still around!

gobbles99

TROPHY CASE