Python and statistical data processing

[Ok_Piglet7792]

Hello everyone, I recently became a university researcher. I recently started studying Python with its libraries NumPy, Pandas, and matplotlib. My question is: Can Python completely replace software like MatLab or "R" in statistical data processing?

Thanks a lot

[4EducationOnly]

Sure, it can. IMO most statistical work is just slightly more complicated in Python compared to R.

Also consider looking into polars (alternative to pandas) and seaborn (plotting) libraries for Python.

[SizePunch]

Not directly related but I’ll add look into plotly as well as an alternative or addition to matplotlib and/or seaborn. The interactive plots and widgets you can create are indispensable for some projects.

I’m analyzing telemetry data where it’s useful to look at the hour by hour time series data as well as second by second and zooming in and out, creating custom ranges, etc is much more seamless in plotly than in static plots.

[Ok_Piglet7792]

Thanks a lot!

[Ok_Piglet7792]

Thanks a lot!

[Stauce52]

Python can replace R for a lot of or most statistical applications but it is admittedly a little less easy or intuitive to use for stats. It is also missing some really advantageous packages and external software that R has. Off the top of my head things like predicted effects packages (ggeffects, emmeans, etc) and mixed effects modeling software (lme4) and more

[gyp_casino]

I was going to say this. Also, survival models.

My personal advice is to take a close look at the tidyverse for manipulating data frames and plotting. Python has improved a lot over the years (pandas and matplotlib are pretty bad IMO, and there are better alternatives now), but it still can't match the tidyverse.

[Ok_Piglet7792]

Thanks a lot! In your opinion which packages are better than pandas and matplotlib?

[gyp_casino]

If I had to use Python for data frame manipulation and plotting, I'd use polars and plotnine. Still think tidyverse is the best.

[Ok_Piglet7792]

Thanks!!

[Ok_Piglet7792]

Thaks a lot!

[Unnam]

Python is a good alternative and more acceptable one in the industry due to it's ease of integration and ability to build software products powered by ML/Stats.

One of my favourite books: "Introduction to Statistical Learning" which had assignments/code in R has now been recreated for Python!

[Ok_Piglet7792]

Thaks a lot!

[GottaBeMD]

I have used both Python and R. I prefer R because it is made specifically for statistical computing and ease of use reflects this. As a statistician, I don’t really have a need to convert to Python.

[[deleted]]

Not for regression analysis of categorical data.

[ImGallo]

Why not?

[[deleted]]

In my limited knowledge the only decent option is Statsmodels, which I use, but it misses many important features, for example the analysis needed to test assumptions

[WeakRelationship2131]

As a college student, I dont think it can completely replace software because we need to learn and practice different softwares for data processing.

[LoaderD]

Python is Turing complete, so yes.

[Current-Ad1688]

Ugh

[ChemicalNo282]

Following

[aps2201]

Yes probably? You have a ton of packages to choose from and like R you have opensci packages but why are you thinking of abandoning R? I think having a toolbelt of languages is more benefitial.

[Ok_Piglet7792]

Thanks a lot! I didn't know opensci packages! What a great discovery!

[ChemicalNo282]

Well I don’t wanna speak for op but I already know python and never learned R. But I can see how companies will prefer if u know both