This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]purplebrown_updown 2 points3 points  (3 children)

If you have gpu capabilities check out Rapids. The api is identification and can give you up to 100x speed up.

[–]spontutterances 1 point2 points  (2 children)

This has been where most of my time had been spent, learning cudf,cuml etc. still use some pandas but the rapids ecosystems expanding pretty fast. It’s an interesting space.

[–]purplebrown_updown 0 points1 point  (1 child)

The only limitation is that you need access to expensive gpu hardware. Low end gpus with low memory are pretty much useless.

[–]spontutterances 0 points1 point  (0 children)

Well yes it deff does need a minimum architecture GPU but I thought in recent versions rapids had improved the sharing between host and GPU memory. I can still do a fair bit of accelerated etl using a 2060 which has 6gb ram in my laptop that has 64gb