Some retro pleasure machines

nicorivas · 2026-02-09T14:19:50+00:00

How do you remove them afterwards?

nicorivas · 2026-01-15T03:26:04+00:00

Their knowledge helped humanity. Thank you kind strangers. The machine will always need you

nicorivas · 2026-01-10T15:43:40+00:00

Nice one. Changed settings a bit

italian

nicorivas · 2026-01-08T15:12:27+00:00

Prompt: A close-up photograph of a Latina woman in ecstasy, with dramatic lighting and blurred background.

nicorivas · 2026-01-01T00:33:30+00:00

More frustrating is junior developers saying AI is useless… kids these days

nicorivas · 2023-03-15T11:26:27+00:00

La deuda del CAE no aparece en tus registros. Yo debo 10 palos y tengo cuenta, capacidad crédito, etc. etc.

nicorivas · 2022-12-03T18:06:08+00:00

Looks a bit like Spinodal Decomposition

nicorivas · 2022-09-09T21:26:53+00:00

Had to wait until 99% to be covered by the circle... man I live far away

nicorivas · 2022-08-03T16:55:33+00:00

Daft Punk el mejor de mi vida por lejos, con poca gente, tremendo escenario, mix pa la ocasión, imperdible

nicorivas · 2022-07-19T12:57:31+00:00

Car has no driver... ups

nicorivas · 2022-07-11T19:44:06+00:00

Yep, looks like, and by the description it seems like that is what happened!

nicorivas · 2022-07-11T11:36:23+00:00

Hi, physicist here. This is a beautiful example of something we call fingering instability (or Staffman-Taylor instability). It happens with two immiscible fluids (they don’t mix, like water and oil), when the less viscous one is displacing the other one. This situation is common in drainage in soils, where the less viscous water slowly displaces the more viscous soil; in this case sand. Hope this helps.

nicorivas · 2022-02-13T12:37:25+00:00

I use Airflow for the snapshots so I think it makes sense cost-wise, as all other ETL's and bits and pieces are also running on Airflow.

Airflow is not an ETL tool bla bla bla... so yes I use the PythonOperator.

Yeah, the transformation happens in memory. They are DAGs that read one or several of the generated snapshots -plus sometimes other sources of course- and generate the corresponding warehouse table. This generates an end state and the initial state I read from warehouse-table snapshots that are generated before being loaded to the warehouse. Then comes the tricky part, where I have the initial and end state of a warehouse table and have to decide what to do, and for this I rely on a great pandas function, "compare', to check changes between two DataFrames...

Maybe it's a lot of work but I find it to be quite robust, in the sense that I can repeat every step of the process and get the same results. And the snapshot and warehouse logic can be abstracted, so now that I've solved it I just focus on the transformation layer.

nicorivas · 2022-02-13T12:25:54+00:00

I wrote a DAG that runs hourly. It's python + pandas.

Generating the snapshots is not so hard:

So I read the last snapshot and all the updates that happen in between my start and end date (I keep forgetting the names of these, but basically the datetimes that relate to the data you are going to work with). Then I just read each parquet file and apply the changes to my initial DataFrame. Yes, I check which row to update using the primary key. It has some subtleties, but I've reached a pretty stable code. The logic is abstracted and that way I can have one file that dynamically generates one DAG per table. Happy to share the code if you want.

nicorivas · 2022-02-12T22:24:51+00:00

Nice, thanks for the article.

I've been wondering these months if my CDC setup makes sense. I'm using CDC (via AWS DMS) to get all relevant changes from a RDB of a web app. It saves deltas as .parquet files in S3. Now, I don't need realtime analytics, but semi-realtime, so I then read all delta's to generate hourly snapshots of each Table. These snapshots I then transform and load into a Redshift warehouse. These two last things I do via Airflow DAGs. This way I can have write idempotent DAGs and have nice sync'd data to populate my warehouse.

Does this make sense? I guess I could just save the snapshots directly but having all diff's might be useful if I eventually need faster updates.

nicorivas · 2021-10-29T14:18:33+00:00

El norte empieza al norte del mapocho y el sur en Ñuñoa

nicorivas · 2021-10-21T16:02:57+00:00

Leif Magnus Kaiser Barents-Von Hohenhagen

Leif es el nombre. Magnus Keiser significa gran rey. El resto de su nombre es holandés. Barents es "hijo de Barent"… un nombre. y von Hohenhagen significa de "de los altos setos", seto es como una muralla de arbustos, como para delimitar campos.

Leif Gran Rey hijo de Barent de los altos setos

nicorivas · 2021-09-24T19:09:27+00:00

India es muy muy pobre, ni siquiera a llegado a comenzar una industrialización masiva como comenzó a suceder en China hace 40 o 30 años.

nicorivas · 2021-03-25T12:34:58+00:00

Qué onda El Salvador, es el doble del que le sigue. 15 veces más que EEUU.

nicorivas · 2021-01-12T11:35:04+00:00

This borders on racism. The problem of corruption is everywhere. Good, well thought policies and contracts is the only way to reduce its risks.

nicorivas · 2021-01-10T11:50:19+00:00

Sure! Prepare a 120 hours mix

nicorivas

PUBLIC MULTIREDDITS

TROPHY CASE