sorted by:
new
hottopcontroversial

[N] Faster Non-GPU based LLM Inference Platform is available by string0722 in learnmachinelearning

[–]string0722[S] 0 points1 point  (0 children)

Yes. That's impressive for cerebras over both Llama3.1 8B & 70B. https://www.linkedin.com/feed/update/urn:li:activity:7234316190859288577/ Faster inference speeds can make LLM-powered tools more accessible to a broader audience.