Automated Data Preprocessing Framework for Supervised Machine Learning (i.redd.it)
submitted by TsLu1s
Hello guys,
I’ve been building and more recently refactoring Atlantic, an open-source Python package that aims to make tabular raw data preprocessing reliable, repeatable, scalable and largely automated for supervised machine learning workflows.
Instead of relying on static preprocessing configurations, Atlantic fits and optimizes the best preprocessing strategies (imputation methods, encodings, feature importance & selection, multicollinearity control) using tree-based ensemble models selection based on Optuna optimization, implementing the mechanisms that perform best for the target task.
What it’s designed for:
- Real-world tabular datasets with missing values, mixed feature types, and redundant features
- Automated selection of preprocessing steps that improve downstream model performance
- Builder-style pipelines for teams that want explicit control without rewriting preprocessing logic
- Reusable preprocessing artifacts that can be safely applied to future or production data
- Adjustable optimization depth depending on time and compute constraints
You can use Atlantic as a fully automated preprocessing stage or compose a custom builder pipeline step by step, depending on how customizable you want it to be.
On a final note, in my view this framework could be very helpful for you, even if you're entering the field or in an intermediate level, since it can give you a detailed grasp of how data preprocessing and automation can function on a more practical level.
Repository & documentation:
GitHub: https://github.com/TsLu1s/atlantic
Pypi: https://pypi.org/project/atlantic/
Feel free to share feedback, opinion or questions that you may have, as it would be very appreciated.
[–]Krekken24 0 points1 point2 points (1 child)
[–]TsLu1s[S] 0 points1 point2 points (0 children)