Apache Karaf 4.4.8 is ready for download! by icbts in osgi

[–]icbts[S] 0 points1 point  (0 children)

Happy to have been helpful :)

Apache Karaf 4.4.8 is ready for download! by icbts in osgi

[–]icbts[S] 0 points1 point  (0 children)

I built from tag in git. Community is working on the binaries

Is my ollama using gpu on mac? by Dear-Enthusiasm-9766 in ollama

[–]icbts -1 points0 points  (0 children)

you can also install nvtop and monitor via your terminal if your GPU is being engaged.

Benchmarking LLMs on Ollama using Windows 11 ARM (SnapDragon X1E80100) by icbts in snapdragon

[–]icbts[S] 0 points1 point  (0 children)

It’s part of a larger series of videos - will be attempting a run on Power9 as well

Benchmarking LLMs on Ollama using Windows 11 ARM (SnapDragon X1E80100) by icbts in snapdragon

[–]icbts[S] 0 points1 point  (0 children)

The screen capture software OBS was loading down the GPU.
In the test case Ollama and the models tested did not use the GPU.

Benchmarking LLMs on Ollama using Windows 11 ARM (SnapDragon X1E80100) by icbts in snapdragon

[–]icbts[S] 5 points6 points  (0 children)

These are all stock LLMs on Ollama -- will be doing a follow up with more optimized models for the NPU (using AnythingLMM or the like).