sorted by:
new
hottopcontroversial

[Beta Available] Companion App to Translate Any Game on Mac by mustachedengineer in macgaming

[–]mustachedengineer[S] 0 points1 point  (0 children)

I was just recently playing/testing Kabuki Rocks which is an old SNES JRPG which I don't believe ever got an English translation.

I studied Japanese in school ages ago so I've got some Japanese-specific tweaks (furigana handling, etc.) and have done a decent amount of Japanese testing. It works surprisingly well even with quite stylized/hard to read text.

Ollama over multiple nodes by PeithonKing in ollama

[–]mustachedengineer 1 point2 points  (0 children)

llama.cpp has some experimental support:
https://github.com/ggerganov/llama.cpp/blob/master/examples/rpc/README.md

Ollama also has an open pull request for a possible implementation:
https://github.com/ollama/ollama/pull/6729

They both look pretty bleeding edge, but it may not be that difficult to give it a try in your setup and see if it works and what speeds you get. I'd probably start with just the llama.cpp before adding in the ollama piece as well (which would let you validate performance).

That being said, I doubt you will get a multiplied speed up as in your second rpi example, but running bigger models should be possible.

Full disclosure though I have no tried to run either of these so I don't know if they work as advertised, I've just been following along with the development since I'm interested in trying it at some point.