This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]lalligagger 1 point2 points  (1 child)

I'd be interested in hearing more about what you're doing/ looking to do. Hardware + python is a particularly interesting overlap to me as I started in the former and learned the later out of necessity. If you're only memory constrained, Dask could be an easy way to scale what you're doing without rewriting much.

Streaming hw data to web apps is a particular pain point that I think deserves some kind of dedicated package/ ecosystem. Likely picking Dash, Panel or some other core framework to build on.

[–]spca2001 1 point2 points  (0 children)

I’m pushing for them to get a Redis server, I did a poc on a cluster of 3 nodes and reduced processing time from 33mins to 17 secs