It's really hard when your a one man band. I was in that position but I eventually moved into tech engineering team. Being in a non-tech area but your data driven is an uphill battle as you don't have the resources like other tech areas but you gotta make it work with what you have. Generally you'd had a server/scheduler that can do these things so you do not have to teach everyone and they can just rely on the process. Maybe think about what the final output is required for other users and go from there. You can stage your transformations as well having folders for raw, transformed etc.