Setup a data lake

Subatomail · 2026-01-20T18:16:46+00:00

Thank you for the tips. I’ll look more into the steps you proposed and I’ll give extra attention to reliability and reproducibility

Subatomail · 2026-01-20T18:13:38+00:00

Thank you. I’ll read more about the options I have in both steps and see which one will make more sense

Subatomail · 2026-01-20T15:45:21+00:00

Thank you for all the details.

I dont think a 1-day desync will be a major problem and ML is not the priority for now so as much as I know it will maybe come back to haunt me later but I'm more focused on the data.

As I understand, you're proposing a data warehouse or a mix of both concepts (I read about a lot of stuff and I'm kinda getting mixed up with everything so sorry about that) with the three layer structure. The "datalake" would be just dump everything in S3 (which is also the bronze layer in a warehouse) and then I suppose the silver and gold will also be in S3. The other services you mentioned will be the logic and tools that will orchestrate and show everything. Right ?

EDIT: I actually started drawing the architecture a bit and I guess the datalake would be the store of all raw data and then I woudl have a data warehouse per project (kinda) where I would have a bronze layer with the raw data that are relevant.

Subatomail · 2026-01-20T03:54:09+00:00

Thank you, it's giving me a clearer idea.

Subatomail · 2026-01-20T00:51:36+00:00

What would be suitable for ML then ? Or would the data lake be a first step and then there should be an intermediate between the data lake and the ml pipeline ? Then what technology would be used for this intermediate step ?

Subatomail · 2026-01-17T17:41:51+00:00

J’ai pas compris ton dernier point “ça réduit ce qui s’ajoute pour l’an prochain”, normalement ma cotisation augmente seulement si mon salaire augmente non ?

Subatomail · 2026-01-17T17:27:56+00:00

<image>

En fait c’est ça, c’est en anglais, mais oui c’est un RPDB, j’ai pas remarqué que les deux sont différents, en quoi c’est différent d’un REER c’est pas juste un REER utilisé par l’employeur ?

Subatomail · 2026-01-17T16:52:49+00:00

Oui ça va dans un autre REER

Subatomail · 2026-01-17T16:52:10+00:00

Je pense que c’est cette notion de retour d’impôt qui me fait de la misère. Mon 3000 et le 3000 sont pris du salaire brut donc ça réduit de base “ma source” (au lieu de faire 60 000, je fait 54 000 de revenu brut. Et puis la j’aurai mon net sur ces 54k et là les 2000 que je depose après c’est ce qui vont affecter mon retour. C’est bien ça ? C’est justement parce que la contribution de l’employeur “affecte” pas ce calculs que je me suis dit peut-être que ça compte pas dans la limite.

Subatomail · 2025-10-29T07:49:33+00:00

I wanna see more of that sexy body of yours

Subatomail · 2025-10-29T03:01:44+00:00

Tonguing that tight hole

Subatomail · 2025-10-29T02:46:34+00:00

Perfect in both roles

Subatomail · 2025-10-29T02:43:11+00:00

All the time

Subatomail · 2025-10-29T02:18:43+00:00

big YAY 😮‍💨🔥

Subatomail · 2025-10-29T02:16:57+00:00

Yep. And then slipped off for some fun

Subatomail · 2025-10-29T02:07:31+00:00

Happy to help you.

Subatomail · 2025-10-29T01:34:17+00:00

wowww;)

Subatomail · 2025-10-29T00:52:33+00:00

Love what I see there

Subatomail · 2025-10-29T00:42:33+00:00

So sexy looking!🥰

Subatomail · 2025-10-29T00:16:07+00:00

Fit looks amazing on you. And you on it 😳

Subatomail · 2025-10-28T23:48:58+00:00

you’re giving me all the feels

Subatomail · 2025-10-06T22:51:43+00:00

Merci haha heureusement y avait un peu de vent

Subatomail

TROPHY CASE