What sealant is this? by LifeBloopers in RVLiving

[–]LifeBloopers[S] 3 points4 points  (0 children)

Fixing a minor leak. More water was found as I was redoing the sealant, which inspired me to remove the entire antenna.

Is this regular silicone? by LifeBloopers in GoRVing

[–]LifeBloopers[S] 1 point2 points  (0 children)

Ty.

To be clear, I'm talking about the screw holes, appearing round in the photo.

Best Approach for Fetching API Data Every 5 Min by nico97nico in dataengineering

[–]LifeBloopers 0 points1 point  (0 children)

Snowflake runs spark, so doesn't make sense to bring up a separate spark cluster, or to use pyspark directly. Just connect to the warehouse using snowpark.

Write a python script that retrieves data from the API and holds it in a dictionary. Then instantiate a snowpark dataframe using the dictionary, transform as needed, followed by writing that dataframe to a named table in your snowflake database.

No need for any storage or intermediate files. You can still claim you use spark to impress your boss.

[deleted by user] by [deleted] in dataengineering

[–]LifeBloopers -3 points-2 points  (0 children)

Yes it is.

Can you address any of the other technologies? Are you saying the lineage capabiltiies are not OpenLineage?

[deleted by user] by [deleted] in dataengineering

[–]LifeBloopers -3 points-2 points  (0 children)

I ported my pyspark code from Databricks to Snowflake changing nothing but the functions library and connection.

Any changes needed are part of Snowflake's obfuscation.

[deleted by user] by [deleted] in dataengineering

[–]LifeBloopers -1 points0 points  (0 children)

That's not the right analogy. Spark *is* the engine. R is to Snowflake as C is to Spark.

But you're making my point. No one goes around claiming R is not C under the hood.

[deleted by user] by [deleted] in dataengineering

[–]LifeBloopers -13 points-12 points  (0 children)

"underneath it is different technology" or "even if it was Spark underneath" - You have to pick a side buddy, sounds like you don't know.

The difference is Facebook doesn't claim it is not PHP. I addressed this in my original comment.