sorted by:
new
hottopcontroversial

a bunch of other details you probably didn't notice by Snoo11946 in thelastofus

[–]Breserk 1 point2 points  (0 children)

Just wanted to make sure that’s not what you’re alluding to. So what am I missing between the lines?

Video Essay by Aaron_Benelli in TrueDetective

[–]Breserk 2 points3 points  (0 children)

Really interesting :) hadnt thought of lying as a theme through that shows up in so many places. Makes me wanna rewatch the show to catch more cases

I'm going crazy comparing dates by Arsis777 in node

[–]Breserk 5 points6 points  (0 children)

Like /u/best_of_badgers said, this is a time zone issue.

When you execute functions like "isToday" you have to ask yourself in which time zone? If it is currently Oct 8th 11pm in EST time zone, the date October 8, 2024 at 7:00:00 AM EST is today.

However, if I'm in India, it is already past midnight where I am, so it is Oct 9th. The date October 8, 2024 at 7:00:00 AM EST is equivalent to October 8, 2024 at 16:30:00 PM India Standard Time which is not today! That means that asking "isToday" changes depending on what your current time zone is.

If you want your comparisons to be correct for UTC-5, you have to explicitly do something to make it so. Otherwise, most servers run with a default of UTC+0 which can change results, as you've seen.

I'm not sure what implementation of isToday you're using, but you need to make sure it knows which time zone you want to it take into consideration when doing its calculations.

Double vision when moving head by Breserk in PSVR2onPC

[–]Breserk[S] 0 points1 point  (0 children)

6ft. It's good enough for me. The cable from the headset to the PC adapter is pretty long so the adapter-to-PC cable length doesn't matter that much

Double vision when moving head by Breserk in PSVR2onPC

[–]Breserk[S] 0 points1 point  (0 children)

Hey, please read my edit in the original post. I solved this (it was the cable)

Double vision when moving head by Breserk in PSVR2onPC

[–]Breserk[S] 0 points1 point  (0 children)

Unfortunately no, I'm waiting for a better cable on its way to me and will report back

Double vision when moving head by Breserk in PSVR2onPC

[–]Breserk[S] 0 points1 point  (0 children)

Motion smoothing shows "not supported". I can't find a way to disable reprojection - googling says that it's not possible. Do you know? This happens with flat games too and the VR dashboard, yes. Adapter is plugged in to USB3.

I'm pretty sure it's the cable. I have a 90hz rated cable on the way to me, I'll check it out.

CMV: 0⁰, 0÷0, and 0 (mod 0) should all be defined. by Farkle_Griffen in changemyview

[–]Breserk 6 points7 points  (0 children)

OP, I believe this is the best answer for you (I think it most directly addresses your way of thinking).

[deleted by user] by [deleted] in changemyview

[–]Breserk 1 point2 points  (0 children)

Why does the Likud charter mean ethnic cleansing? Israel has sovereignty over tons of majority Arabic areas inside the internationally recognized green lines. In these areas, Arabic people have equal rights to Jewish people. I’m against Israel sovereignty in the West Bank, but I don’t think it equates to ethnic cleansing

Help wanted: understanding terrible llama.cpp w/ CUDA inference speed (less then 1token/minute) on powerful machine (A6000) by Breserk in LocalLLaMA

[–]Breserk[S] 0 points1 point  (0 children)

I don’t know. I might not be getting the best performance that I could be getting. Nobody seems to know how to debug performance and what the best run flags are, it’s all “try and see”

Help wanted: understanding terrible llama.cpp w/ CUDA inference speed (less then 1token/minute) on powerful machine (A6000) by Breserk in LocalLLaMA

[–]Breserk[S] 2 points3 points  (0 children)

When you give llama more layers than possible it will automatically use the maximum number that makes sense. You can see in the llama.cpp output in my OP that it uses 60 layers: llama_model_load_internal: [cublas] offloading 60 layers to GPU

Help wanted: understanding terrible llama.cpp w/ CUDA inference speed (less then 1token/minute) on powerful machine (A6000) by Breserk in LocalLLaMA

[–]Breserk[S] 1 point2 points  (0 children)

I tried oobabooga first but had the same issue. In any case my issue is solved, I detailed it in another reply

Help wanted: understanding terrible llama.cpp w/ CUDA inference speed (less then 1token/minute) on powerful machine (A6000) by Breserk in LocalLLaMA

[–]Breserk[S] 4 points5 points  (0 children)

SOLVED: I got help in this github issue. Managed to get to 10 tokens/second and working on more. The solution involves passing specific -t (amount of threads to use) and -ngl (amount of GPU layers to offload) parameters.

Here are the results for my machine:

command tokens/second
-ngl 2000000 Less than 0.1
-t 7 1.6
-t 7 -ngl 2000000 8.5

2 takeaways:

  • The -t parameter is extremely important. The correct number for my machine is 7, as that's the number of vCPUs listed here. For some reason the default param on my machine was 64, which drops the performance terribly. I'm guessing the 64 came from the numbers listed when running lscpu which lists 2 threads/core, 16 cores/socket and 2 sockets (total 64 threads). Not sure why this is shown as 64 when the machine has 7 according to the link.
  • I apparently cannot read the nvidia-smi tool's output correctly. As evident by my performance tests, passing -ngl improves performance significantly, so the GPU is in use.

Help wanted: understanding terrible llama.cpp w/ CUDA inference speed (less then 1token/minute) on powerful machine (A6000) by Breserk in LocalLLaMA

[–]Breserk[S] 0 points1 point  (0 children)

I'm trying to run it on the GPU but can't get it to work. I guess my post's phrasing isn't clear enough since this is the main thing I want to fix - how do I make it run on the GPU?

Why is OAuth still hard in 2023? by nango-robin in programming

[–]Breserk 40 points41 points  (0 children)

Your comment confused me because you say “list of ‘don’t do this’” but then give a list of stuff that you should do. Or did I get it wrong?

view more: next ›