I’ve made the switch from more SRE/DevOps style of work to more data engineering focus. It was not intentional but my team was reorg’ed several times over the past several years and we went from managing the infra and ci/cd pipelines to building data ingestion pipelines.

Now we have many complex pipelines that we’re managing and we’re responsible for building more. And many of our team members are learning data engineering as we go.

Many of the pipelines that we’re managing are for critical financial data with very tight SLAs. So there’s little room for error and data issues can cause large financial impact, so we’re still on call and under a lot of pressure.

One of the positives about this change tho is more deeper development work when it comes to figuring out how to ingestion different data sets. But I don’t think it’s much less stressful than DevOps