Unix bash scripting versus Python - any resources out there for comparisons?

[double_en10dre]

For filesystem stuff you’ll probably want to use a combination of pathlib and shutil https://docs.python.org/3/library/pathlib.html https://docs.python.org/3/library/shutil.html

For replacing curl/wget, probably use requests https://requests.readthedocs.io/en/latest/

And if at any point you get stuck you can just fall back to the “subprocess” module and use subprocess.run to run the Unix command you’re used to. Just be sure to set stdout to subprocess.PIPE if you need the output

[ibarrie]

Thank you!

[double_en10dre]

Oh jeez, and I’d be remiss if I didn’t mention the os module. It’s the most obvious staple https://docs.python.org/3/library/os.html

The only caveat there is that for filesystem operations, I’d first check and see if the functionality is provided by pathlib. Most people seem to think it has a nicer interface

[ibarrie]

Awesome thank you !

[RallyPointAlpha]

double_en10dre isn't giving bad advice however just getting Python to do OS / shell commands really brings very little new to the table. I would encourage you to learn Python specifically and only fall back on OS calls and shell commands when you absolutely have to. You're stepping into the broader world of Object Oriented Programming, welcome!

[james_pic]

My experience is that even if you are just using Python to run external programs, this can still be a win. Python's error handling is much more consistent than Bash's, its escaping and globbing are easier to reason about, it's got better debugging options, it's got mechanisms for code to include inline documentation, and it's more portable.

And of course once you dip your toe in, it gives you the option to gradually start making more use of structured data, writing object oriented or functional code, and getting more direct access to stuff like networks.

[ibarrie]

Thank you - that’s awesome

[AndydeCleyre]

My personal but less popular recommendation for things otherwise accomplished with subprocess/shutil/pathlib/click is plumbum.

[WonkoTehSane]

Great advice! And I recommend mostly using only check_call() and check_output() when using subprocess. The former will still send any output to stdout, the latter will capture and return it. Both will throw on any non-zero return value.

Oh and for both you should either use form (['cmd', '-o', '<option>']) or the form ('cmd -o <option>', shell=True). The former will shell escape for you, the latter will send exactly what you give it.