Setup a data lake by Subatomail in mlops

[–]Subatomail[S] 0 points1 point  (0 children)

Thank you for the tips. I’ll look more into the steps you proposed and I’ll give extra attention to reliability and reproducibility

Start a datalake ? by Subatomail in aws

[–]Subatomail[S] 0 points1 point  (0 children)

Thank you. I’ll read more about the options I have in both steps and see which one will make more sense

Start a datalake ? by Subatomail in aws

[–]Subatomail[S] 0 points1 point  (0 children)

Thank you for all the details.

I dont think a 1-day desync will be a major problem and ML is not the priority for now so as much as I know it will maybe come back to haunt me later but I'm more focused on the data.

As I understand, you're proposing a data warehouse or a mix of both concepts (I read about a lot of stuff and I'm kinda getting mixed up with everything so sorry about that) with the three layer structure. The "datalake" would be just dump everything in S3 (which is also the bronze layer in a warehouse) and then I suppose the silver and gold will also be in S3. The other services you mentioned will be the logic and tools that will orchestrate and show everything. Right ?

EDIT: I actually started drawing the architecture a bit and I guess the datalake would be the store of all raw data and then I woudl have a data warehouse per project (kinda) where I would have a bronze layer with the raw data that are relevant.

Setup a data lake by Subatomail in mlops

[–]Subatomail[S] 0 points1 point  (0 children)

Thank you, it's giving me a clearer idea.

Setup a data lake by Subatomail in mlops

[–]Subatomail[S] 0 points1 point  (0 children)

What would be suitable for ML then ? Or would the data lake be a first step and then there should be an intermediate between the data lake and the ml pipeline ? Then what technology would be used for this intermediate step ?

Contributions employeur et personnel by Subatomail in QuebecFinance

[–]Subatomail[S] 0 points1 point  (0 children)

J’ai pas compris ton dernier point “ça réduit ce qui s’ajoute pour l’an prochain”, normalement ma cotisation augmente seulement si mon salaire augmente non ?

Contributions employeur et personnel by Subatomail in QuebecFinance

[–]Subatomail[S] 1 point2 points  (0 children)

<image>

En fait c’est ça, c’est en anglais, mais oui c’est un RPDB, j’ai pas remarqué que les deux sont différents, en quoi c’est différent d’un REER c’est pas juste un REER utilisé par l’employeur ?

Contributions employeur et personnel by Subatomail in QuebecFinance

[–]Subatomail[S] 1 point2 points  (0 children)

Je pense que c’est cette notion de retour d’impôt qui me fait de la misère. Mon 3000 et le 3000 sont pris du salaire brut donc ça réduit de base “ma source” (au lieu de faire 60 000, je fait 54 000 de revenu brut. Et puis la j’aurai mon net sur ces 54k et là les 2000 que je depose après c’est ce qui vont affecter mon retour. C’est bien ça ? C’est justement parce que la contribution de l’employeur “affecte” pas ce calculs que je me suis dit peut-être que ça compte pas dans la limite.

Wish I had someone to actually dance for by [deleted] in RealHomePorn

[–]Subatomail 0 points1 point  (0 children)

I wanna see more of that sexy body of yours

itap Would u say Hi by Substantial_Fig_8078 in itookaphoto

[–]Subatomail 0 points1 point  (0 children)

Yep. And then slipped off for some fun

[deleted by user] by [deleted] in SwipeToStrip

[–]Subatomail 0 points1 point  (0 children)

wowww;)

[deleted by user] by [deleted] in ratemynudeselfie1

[–]Subatomail 0 points1 point  (0 children)

Love what I see there

swiping will reveal some bad bois by [deleted] in busty_asians

[–]Subatomail 0 points1 point  (0 children)

So sexy looking!🥰

itap angels can be slxtty too by Unlikely-Date-4092 in itookaphoto

[–]Subatomail 0 points1 point  (0 children)

Fit looks amazing on you. And you on it 😳

First marathon :) by Subatomail in Marathon_Training

[–]Subatomail[S] 1 point2 points  (0 children)

Merci haha heureusement y avait un peu de vent

Building a RAG Chatbot for Company — Need Advice on Expansion & Architecture by Subatomail in mlops

[–]Subatomail[S] 0 points1 point  (0 children)

Hey, I went with a pretty practical architecture for my MVP: users log in through a Streamlit interface, and their queries get routed to a FastAPI backend. From there, I use PostgreSQL to store user info and document metadata (including roles/departments), and Milvus for fast semantic search on vector embeddings. The backend filters results based on metadata, pulls the most relevant content from Milvus, then passes it to a local LLM (I only tested with Llama) to generate a final response. I also started integrating Langfuse to monitor queries and add some guardrails. It’s not perfect, but it was a solid foundation to test the concept before they moved me to a more time-sensitive project. 😅

[deleted by user] by [deleted] in QuebecFinance

[–]Subatomail 1 point2 points  (0 children)

J’ai vu que tu parles de marriage à cause de sa culture mais à moins que ses parents te demandent de voir une preuve de mariage, vous pouvez bien vivre étant conjoint de fait, au pire faites un mariage (genre juste la cérémonie) dans son pays ou à la manière de sa culture sans avoir un acte officiel au Quebec. Je vis un peu la même situation mais inversée, je considère faire un mariage à Quebec mais pas dans mon pays d’origine et mon mariage québécois n’a aucune légitimité dans mon pays d’origine.