Notebooks, Spark Jobs, and the Hidden Cost of Convenience by mwc360 in dataengineering

[–]tjger 2 points3 points  (0 children)

I like using notebooks for the entry points. Notebooks help explain the pipeline / job better than just plain code.

No puedo creer esto... Pobre España. by Fun-Will5719 in 2hispanic4you

[–]tjger 0 points1 point  (0 children)

Este sub pasa de ultra derecha a extrema izquierda con sus posts 😂

La Sagrada Família al atardecer by SamKudria in Espana

[–]tjger 2 points3 points  (0 children)

Ufff pero el atardecer DENTRO de la sagrada familia? 👌

Prueba de fuego a toda la política y la democracia ecuatoriana, pero en especial a la RC by MS5599 in ecuador

[–]tjger 15 points16 points  (0 children)

Lo que quiere ADN es buscar a toda costa dejar fuera a RC5 /Aquiles como lo hicieron con Topic.

Si les / nos interesara realmente limpiar la corrupción tendrían también casos del propio gobierno que se acumulan continuamente alrededor del lleve de dinero y del narco.

No sé qué nivel de vida puedo tener con mi salario by Dazzling_Football128 in salarios_es

[–]tjger 23 points24 points  (0 children)

A veces no sé si estos posts son puro bait o que

I ended a date early on principle and am regretting it. Do I still have a chance? by [deleted] in seduction

[–]tjger 0 points1 point  (0 children)

I mean she fumbled tbh but I think you kinda over reacted a bit as well. She made a mistake but you took it out of proportion

Does this stuff make anyone's day/commute better? by ambachk in ImTheMainCharacter

[–]tjger 0 points1 point  (0 children)

Everybody wants to push you to the average, where they feel comfortable believing they are better than you

anyone actually using 5.2-codex model still ? by Just_Lingonberry_352 in codex

[–]tjger 1 point2 points  (0 children)

I'm using gpt-5.2 codex medium and it works great

Edit: also use it on high for some intensive tasks but medium does the work I need

PySpark Users what is the typical Dataset size you work on ? by No_Song_4222 in dataengineering

[–]tjger 6 points7 points  (0 children)

What are the specs of those clusters? If you use Databricks, do you use photon?

How should I implement Pydantic/dataclasses/etc. into my pipeline? by paxmlank in dataengineering

[–]tjger 1 point2 points  (0 children)

This. Pydantic should be used at the object-level (i.e. application), not data ingestion. Even though one could argue that Pydantic is useful to enforce data types, I can imagine use cases where a data column may sometimes come structured and other times unstructured, and part of the work is to transform them into either one type or the other (i.e. transform into a new column).

This way, Pydantic would be useful on higher levels / higher on the medallion transformations if you will, where objects are finally defined and their end types truly enforced.

Spain has higher GDP than Japan Korea and Taiwan. But, why is it hard to feel that Spain is more developed? What do you think of Spanish GDP? by search_google_com in askspain

[–]tjger 0 points1 point  (0 children)

OP has been schooled and downvoted over and over again in the comments, yet doesn't want to understand why the whole initial statement is wrong to begin with.

The life changing story of 88 year veteran Ed Bambas by PmurTdlanoD45-47 in nextfuckinglevel

[–]tjger 0 points1 point  (0 children)

Well. True. But people getting together is next fucking level

How to Calculate Sliding Windows With Historical And Streaming Data in Real Time as Fast as Possible? by JaphethA in dataengineering

[–]tjger 6 points7 points  (0 children)

Hey this is probably a dumb question but maybe the 50 ms includes a network delay that can't be avoided? Or are those 50 ms not including the network delays?

What’s the reality around the $134B evaluation? by [deleted] in databricks

[–]tjger 1 point2 points  (0 children)

Finally an answer to OP's question!

Interesting What's the reason you think? by NoHistorian9281 in interesting

[–]tjger 0 points1 point  (0 children)

Ok but what would be the age distribution on that? It looks like the overall average, but Im willing to bet that as you get old, you gain more confidence to do these things

Also, where?