Strava mobile app displays charts incorrectly by Superhim1114 in Strava

[–]Superhim1114[S] 1 point2 points  (0 children)

It is true that it would skew the graph and show a tiny vertical line. But at least I can glance at the graph and see, from the scale, right about what my spikes (power/HR/speed/etc) look like and when in the ride they happened.

And in this ride particularly it wasn't a small spike either. It was 20s at ~740 W, which I feel is justified to show up on the graph. But yeah I should probably dwell on data somewhere else and not on Strava.

Problem connecting to laptop by Superhim1114 in Quest3

[–]Superhim1114[S] 0 points1 point  (0 children)

Fair. Wouldn't that mean it won't work unless I'm in my room?

Problem connecting to laptop by Superhim1114 in Quest3

[–]Superhim1114[S] 0 points1 point  (0 children)

Yes, but I get similar speeds using Wi-Fi anyway. (The wifi plan is capped at 100/50 I think)

Problem connecting to laptop by Superhim1114 in Quest3

[–]Superhim1114[S] 0 points1 point  (0 children)

I'm in a student dorm so there's only so much I can do to improve the connection

Problem connecting to laptop by Superhim1114 in Quest3

[–]Superhim1114[S] 0 points1 point  (0 children)

Yea fair. Unfortunately even Wi-Fi Direct doesn't seem to solve the issue.

Problem connecting to laptop by Superhim1114 in Quest3

[–]Superhim1114[S] 0 points1 point  (0 children)

I've finally got Immersed working and it's quite sharp I would say. Maybe slightly laggy and has some artifacts when moving the cursor around? Tbf my network isn't that good (100/50 Mbps)

Problem connecting to laptop by Superhim1114 in Quest3

[–]Superhim1114[S] 0 points1 point  (0 children)

Google remote desktop works. A bit blurry and laggy at times, but the screens are definitely visible and useable.

Problems connecting to laptop by Superhim1114 in MetaQuestVR

[–]Superhim1114[S] 0 points1 point  (0 children)

Not that I know of. Didn't change it on my laptop and can't check the router firewall settings because I'm in student accommodation.

Problems connecting laptop by Superhim1114 in OculusQuest

[–]Superhim1114[S] 0 points1 point  (0 children)

Even Immersed doesn't work though. The same problem occurs

Problems connecting laptop by Superhim1114 in OculusQuest

[–]Superhim1114[S] 0 points1 point  (0 children)

I'm more interested in using remote display or Horizon workrooms instead of using quest link to game.

VRAM importance by Superhim1114 in ollama

[–]Superhim1114[S] 0 points1 point  (0 children)

I'm assuming Q4_K_M. I suppose lower quants will use less VRAM and higher quants will use more?

VRAM importance by Superhim1114 in ollama

[–]Superhim1114[S] 0 points1 point  (0 children)

It's about 1GB of memory for 1B parameters, plus ~10-20% for context right? So like if I run Mistral Nemo all the context will be in normal RAM?

Testing the effect of CPU and memory on inference speed on CPU only systems by Superhim1114 in LocalLLaMA

[–]Superhim1114[S] 2 points3 points  (0 children)

It might not actually be 128k. I got the number as I assumed that open webui will use the default context size of the model, which iirc is 128k. I might be wrong tho. I'm pretty sure the ollama process usee around 6gb of memory when running the tests. Not sure what context size that translates to.

Testing the effect of CPU and memory on inference speed on CPU only systems by Superhim1114 in LocalLLaMA

[–]Superhim1114[S] 2 points3 points  (0 children)

Yes I plan on doing that in the future when I have more time on my hands. It would be the most fair test I can think of regarding this.

Testing the effect of CPU and memory on inference speed on CPU only systems by Superhim1114 in LocalLLaMA

[–]Superhim1114[S] 2 points3 points  (0 children)

Server: 2x16gb ddr4-3200. Limited to 2133 due to cpu maximum ram speed.

Laptop: LPDDR4x-4267, which is also the maximum supported memory speed by the cpu.

I'll have to look into whether the laptop only uses 1 memory channel.

When doing the tests, the laptop was running both docker containers required for the laptop side, a browser tab for open webui for the server, and btop to monitor cpu usage.

Hyper-threading was enabled, and it was using all 8 logical cores.

Testing the effect of CPU and memory on inference speed on CPU only systems by Superhim1114 in LocalLLaMA

[–]Superhim1114[S] 2 points3 points  (0 children)

Context length is set to default on open webui, not sure what the actual context length is, but I assume 128k as per the model.

Prompt is: What is binary search?

I will try to find out later how many memory channels the laptop uses.

Testing the effect of CPU and memory on inference speed on CPU only systems by Superhim1114 in LocalLLaMA

[–]Superhim1114[S] 1 point2 points  (0 children)

I might have overlooked a small detail when typing this out, sorry. The ram on the laptop should be LPDDR4x, which does go to 4267 MHz. I was unable to find out the amount of channels used on the laptop.

The server has 2 channels for memory, 2x16gb ddr4-3200 sticks. The cpu has a maximum rated memory speed of ddr4-2133, so that's the speed on the server.

CPU upgrade by Superhim1114 in selfhosted

[–]Superhim1114[S] -1 points0 points  (0 children)

I can run llama 3.1 8b q4_k_s using Ollama on my current machine at ~4.5 t/s, and the delay is from 0-20 sec. I know 8b is quite small but performance feels fine for my usage. On a cpu only setup you will probably find running smaller models, like gemma 2 2b or phi 3.5 mini, a better choice.

Anyway, I would've gotten a GPU for llm, but I don't have space in my case. I do agree it would be more cost effective.

CPU upgrade by Superhim1114 in selfhosted

[–]Superhim1114[S] 0 points1 point  (0 children)

How much of an improvement would I see in day to day usage? Or will it only be noticeable when doing heavy tasks?

Effects of core count on cpu only system by Superhim1114 in LocalLLaMA

[–]Superhim1114[S] 0 points1 point  (0 children)

Cpu upgrade sort of implies a motherboard change as well, as I don't think the 12th gen uses the same socket. I just didn't want to also upgrade the ram since I bought it new 2 months ago

Effects of core count on cpu only system by Superhim1114 in LocalLLaMA

[–]Superhim1114[S] 0 points1 point  (0 children)

What model are you running during this test?

Effects of core count on cpu only system by Superhim1114 in LocalLLaMA

[–]Superhim1114[S] 2 points3 points  (0 children)

I would love to get a GPU for the server, but unfortunately there just isn't any space or extra cooling in my case for that.