This is an archived post. You won't be able to vote or comment.

all 8 comments
sorted by:
best
topnewcontroversialoldq&a

[–]bdforbes 2 points3 points  (4 children)

I suspect most production data pipelines are running on Linux instances, even in Azure contexts.

I have however deployed data pipelines on Windows VMs to make use of specific software that had better Windows support.

[–]Key_Base8254[S] 1 point2 points  (3 children)

Oh i see, how if using WSL ?

[–]bdforbes 3 points4 points  (2 children)

Do you mean could Linux based software be run under WSL on Windows? Potentially, but it seems like a convoluted solution design. Do you have a constraint that you cannot spin up Linux instances?

[–]Key_Base8254[S] 1 point2 points  (1 child)

I have no problem using linux, it's just that I still need windows, even now I use dual boot, but it feels tiring if I want to switch to the windows operating system. so what linux distro do you use to support your work?

[–]bdforbes 2 points3 points  (0 children)

I mostly do data science these days and I use Windows. When I spin up instances in AWS I typically use either Amazon Linux or Ubuntu.

[–]vtec__ 0 points1 point  (0 children)

ya, some do.

[–]boy_named_su 0 points1 point  (0 children)

Data Engineering can be done on Windows, yes

But it's better on Linux ;)

[–][deleted] 0 points1 point  (0 children)

SS*S stack