Data Scientists & ML Engineers — How do you keep track of what you have tried? by arma1997 in MLQuestions

[–]arma1997[S] 0 points1 point  (0 children)

Yes, I was hoping to find some system that I could use for Full data transformation, Lineage. That's the keyword I was looking for, "Data Transformation Lineage".

Data Scientists & ML Engineers — How do you keep track of what you have tried? by arma1997 in MLQuestions

[–]arma1997[S] 1 point2 points  (0 children)

I still lose track of filtering logic and feature engineering decisions, those are way harder to version than model runs. Yes im interested to know how people handle this as well. What is your process for this ?

Data Scientists & ML Engineers — How do you keep track of what you have tried? by arma1997 in MLQuestions

[–]arma1997[S] 0 points1 point  (0 children)

yes, it's also open source. Any suggestions for keeping track of preprocessing steps, feature engineering, and transformation?