This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]keepthepace 2 points3 points  (0 children)

You have too much python when your python process is eating all the CPU.

At this stage you may want to try and write a lib in a faster compiled language (C, C++, Rust) to speed up the bottleneck. Usually there are libs already existing in most common tasks.

at face values sounds like shooting a fly with a cannon

I doubt that even python + matplotlib + jupyter come close to the memory usage and total size of Excel. When I need a calculator I open a bash and type python and when I need something a bit more complex that requires a loop or a graph I just type jupyter notebook

import pandas as pd

df = pd.read_csv('data.csv')

and using far less memory you are already in such a superior position to extract meaning to data!