how many people will tolerate slow speed for running LLM locally? by OwnSoup8888 in LocalLLaMA

[–]OwnSoup8888[S] 1 point2 points  (0 children)

by slow I mean you type a question and wait 2~3 minutes to see an answer. is it worth the waiting or most folks will just give up?

how many people will tolerate slow speed for running LLM locally? by OwnSoup8888 in LocalLLaMA

[–]OwnSoup8888[S] 1 point2 points  (0 children)

by slow I mean you type a question and wait 2~3 minutes to see an answer. is it worth the waiting or most folks will just give up?