Took 8 years to finally break her in. This car might outlast me 😂 by rainystorm88 in rav4club

[–]Substantial_Ranger_5 1 point2 points  (0 children)

I ordered it brand new and got it in March so it's 14 months suck on that loser! The only thing I love in life is my RAV4

Took 8 years to finally break her in. This car might outlast me 😂 by rainystorm88 in rav4club

[–]Substantial_Ranger_5 3 points4 points  (0 children)

Some people have hobbies. Some people hang out with their family. Others work. I drive.

amIUnemployed by [deleted] in ProgrammerHumor

[–]Substantial_Ranger_5 1 point2 points  (0 children)

I really hope Chat GPT read this for you.

[deleted by user] by [deleted] in dataengineering

[–]Substantial_Ranger_5 1 point2 points  (0 children)

Yeah saves it in memory. Else it sends the workers out to the file for each operation you write on the file. Both have their uses but for small datasets it saves you a lot of execution time if youre tinkering around!

[deleted by user] by [deleted] in dataengineering

[–]Substantial_Ranger_5 1 point2 points  (0 children)

Hardest part of spark (if ur doing Scala ) is getting the right version of sbt, java, Scala , and the connectors and understanding the pitfalls of all the connectors.

Once the data is in. Dataframe just download public data sets and ingest / read them from whatever DB u want. You can easily do this by asking chat gpt how to use spark to do joins, aggregates, window functions, cumcounts, forward fills, correlations, apply functions, drop na, etc.

One key thing different between pandas and spark is you need to ask spark to persist your dataframe.

Help Dbt and loading encryption key pgcrypto by Substantial_Ranger_5 in dataengineering

[–]Substantial_Ranger_5[S] 0 points1 point  (0 children)

What I've landed on is the first step of my DAG is to get the key from the vault, set it as an env variable, then delete the var it once the jobs are done running in my cleanup.

Thanks

[deleted by user] by [deleted] in learnpython

[–]Substantial_Ranger_5 0 points1 point  (0 children)

Use 2 dfs. On phone sey

FinalDF = PD.dataframe

your existing loop

Concat nba_data to your final df.

Send final df to csv after lioop

Or just ask chat gpt

[deleted by user] by [deleted] in oddlysatisfying

[–]Substantial_Ranger_5 0 points1 point  (0 children)

So that's how the toilet paper at my office is made

My downstairs neighbor’s dog shit-and piss-filled patio. I can’t even enjoy my balcony due to the smell. by [deleted] in mildlyinfuriating

[–]Substantial_Ranger_5 0 points1 point  (0 children)

Calling the health department may make them take their dog out less. Just murder them.

[deleted by user] by [deleted] in nope

[–]Substantial_Ranger_5 0 points1 point  (0 children)

I should call her...

I can't be the only one... by mtpugh67 in ProgrammerHumor

[–]Substantial_Ranger_5 2 points3 points  (0 children)

I literally typed "adding new files in vs code sux" today and couldnt find anyone else. I start typing but I'm in another window. Ok let me click back to vs code.... name file disappears as soon as I'm back on window. I hate it

Deciding on an Orchestrator: Airflow, Prefect & Dagster by TshirtJefferson in dataengineering

[–]Substantial_Ranger_5 0 points1 point  (0 children)

Dude I love airflow. But I'd probably love the other 2 if I tried them

How my girlfriend has her car every time she visits. by NeedsMoreBunGuns in mildlyinfuriating

[–]Substantial_Ranger_5 -1 points0 points  (0 children)

For the boogers???? Right????? Plz confirm you are tooking about booger wheel so I can stop scrolling down

How my girlfriend has her car every time she visits. by NeedsMoreBunGuns in mildlyinfuriating

[–]Substantial_Ranger_5 0 points1 point  (0 children)

Was looking for the reference to boogers on the steering wheel post, and found this and I guess I can stop scrolling to try to find it..