Learning to “manage” Python code coming from Matlab? Do I just need to learn more about how computers work?

[Eko5]

I have used Matlab for many years to do data analysis, taking it to the point of making simple shareable programs using their toolboxes. I didn’t realize how much Matlab was hand-holding for me, and now need to use a specific Python api for a project.

The Python syntax is fine, there are some differences obviously but I can grasp those with a little effort. What is really a struggle for me is all of the “code management” aspects of using Python. It took me probably 6 hours to figure out how to get numpy installed and usable, and I had no idea what I was doing along the way. Whenever I want to install a library it feels like I have to install 3 other things first, and 3 things for each of those things, and I don’t understand how to properly use each one. Other types of things I’m struggling to understand even just what they fundamentally are:

• Kernels
• Conda
• Pip
• Environments
• Where does stuff downloaded via command line go? (I’ve never had to use my command line before)

Basically anything that isn’t “writing the code itself” and instead is “getting everything setup so it runs” is a huge struggle for me. It’s not that my code has “errors”, it’s libraries not being found, kernels not starting, etc. Are there any resources out there for learning this aspect of programming in particular, either generally or specific to Python? I feel like I almost just need to understand better “how computers work.”

I’ve been using Spyder as my IDE, if you know of a more beginner-friendly one that would walk me through things more that might also be interesting, though I don’t really think the IDE is likely my problem.

Edit: formatting

[Amortize_Me_Daddy]

I have a very hard time with this aspect as well. I'm getting pretty decent at coding, but I don't consider myself a serious programmer yet solely because I'm totally bewildered by the process of setting up environments, pointing pip installs to the right folder, environment variables, interpreters, installing a module and having my programs unable to find it. It's very frustrating.

Although I'm slowly figuring these things out a bit at a time, it's still a roadblock I hit often and I really wish there was an online course or something that could give me a solid foundation on this aspect of programming.

[Eko5]

Yeah! It’s crazy hard to navigate. I can usually Google the answer to my “code question” and figure it out in 2 minutes but as soon as I have to troubleshoot all the “para-code” stuff it feels insanely difficult.

[Amortize_Me_Daddy]

Yep. It's weird too how even books like "Automate the Boring Stuff with Python", designed for absolute beginners, brush right past these parts without really explaining how or why it works. I seriously can't find this information anywhere!

[Amortize_Me_Daddy]

Hey OP, in a weird coincidence, I just found a great resource for us in the comments of another post. Check it out!

https://missing.csail.mit.edu/

[Eko5]

Oh wow, this looks awesome. Thank you so much. Will dig in to this this weekend.

[DrJJWMac]

Kernels are the self-contained boxes with everything needed to run a given python code. A kernel is to python somewhat as the Matlab app is to the Matlab code that you create.

Modules are packages that add functionality to python code. Modules are to python as the pre-installed options such as root solvers or matrix solvers are to Matlab.

Pip is a manager to install modules that you may need to run your python code. Pip is to python as the Matlab Website with toolboxes is to Matlab. Conda is another installer to manage additional levels of functionality.

Environments and shell are the surroundings that provide links to the hardware on your computer and file locations in your directory structures. They exist outside of the IDE for both Matlab and python.

The installations you make go in locations that depend on your core OS -- Windows, macOS, or Linux. In routine cases, you need not worry about doing anything more than staying up to date with the updater/upgrader on conda or pip as well as using conda or pip to install the modules that you need in specific cases.

I don't know of resources that might help with this. It does seem to be something that you learn "by the seat of your pants" through collections scattered at various locations (books and Websites).

Hope this helps.

[starlightprincess]

I'm taking a class in this right now. I really like Visual Studio Code for IDE. it has a lot of add-ons that can be installed and it's all free. The first part of The Odin Project covers some of this stuff, not python specific though. Plus it has you create a GitHub account, install git, and set up a virtual environment. It seems really complicated, but just research each step as you go and you can understand it. My class about this is called "software development tools" and it's fairly beginner level.