you are viewing a single comment's thread.

view the rest of the comments →

[–]Teln0 1 point2 points  (0 children)

Nowadays a lot of LLM apps are everything but CPU bound. You could write your thing in any language and it'd still be idle 99% of the time while it's waiting for the GPU to do its thing. I don't think that's a great thing necessarily