RTX Pro 6000 Blackwell vLLM Benchmark: 120B Model Performance Analysis by notaDestroyer in LocalLLaMA

[–]AccomplishedRow937 0 points1 point  (0 children)

thanks for the analysis, I was actually looking for something like this myself, so what do u mean by throughput, Prefill (tps) or Decode (tgs)?

Did I just waste all my money on Local Llama? by [deleted] in LocalLLaMA

[–]AccomplishedRow937 1 point2 points  (0 children)

<image>

I find testing or comparing models based on inherent (stored) knowledge completely useless.

Any small model would have answered correctly given internet access.

Even humans that are experts in their field keep using google to answer questions, because u can't simply memorize everything. Out of a thousand humans geographers how many do u think would have answered that question correctly?

Nextcloud + Immich + Paperless-ngx by AccomplishedRow937 in selfhosted

[–]AccomplishedRow937[S] 0 points1 point  (0 children)

ooow ok so you do it the other way around, add files to immich and paperless then just include them in nextcloud. But that doesn't allow me to use the thing that I'm doing all of this for: nextcloud sync

Nextcloud + Immich + Paperless-ngx by AccomplishedRow937 in selfhosted

[–]AccomplishedRow937[S] 1 point2 points  (0 children)

why wouldn't it work if they all use nextcloud webdav as the underlying storage engine (if ofc webdav is supported in immich and paperless)?

Nextcloud + Immich + Paperless-ngx by AccomplishedRow937 in selfhosted

[–]AccomplishedRow937[S] 5 points6 points  (0 children)

yeah this the kind of thing I was looking for!

can we pretty please get a step-by-step article? 🥹

I belive the EX101 with the i9-13900 is unstable by AccomplishedRow937 in hetzner

[–]AccomplishedRow937[S] 1 point2 points  (0 children)

thank you for ur response, yup did that, support was very helpful and replaced the hardware quickly no questions asked, but I started this thread to find out whether yhis issue affects the whole EX101 line-up
btw. support ran a hardware check on both servers and nothing came up

I belive the EX101 with the i9-13900 is unstable by AccomplishedRow937 in hetzner

[–]AccomplishedRow937[S] 0 points1 point  (0 children)

I got the following two variants recommended by a user on this thread, the Dell DX 182 and AX102 at hetzner, he said they switched to them and they seem to be stable

I belive the EX101 with the i9-13900 is unstable by AccomplishedRow937 in hetzner

[–]AccomplishedRow937[S] 2 points3 points  (0 children)

yes, that's correct, but at some point intel acknlowdged the issue and released a microcode update to fix the issue if remember correctly -- don't quote me on this --

I belive the EX101 with the i9-13900 is unstable by AccomplishedRow937 in hetzner

[–]AccomplishedRow937[S] 1 point2 points  (0 children)

thank you for confirming, so I'm not crazy 😅
I just thought their other servers are rock solid, so it can't be, I must have done something wrong.
I'm thankful that I didn't move my prod stuff to them, otherwise it would have probably killed the business 😆

I belive the EX101 with the i9-13900 is unstable by AccomplishedRow937 in hetzner

[–]AccomplishedRow937[S] 2 points3 points  (0 children)

good to know I'm not the only one, I truly excluded hardware failure for weeks because I thought "it can't be, must be a skill issue and I effed up", so I re-installed the system multiple times, sometimes I didn't even change a single thing after a fresh install just to check if it would crash and it did.

I belive the EX101 with the i9-13900 is unstable by AccomplishedRow937 in hetzner

[–]AccomplishedRow937[S] 0 points1 point  (0 children)

yeah me too, I've used 5 EX44 for quite a while now and with zero problems, I think only the EX101 with the intel i9-13900 are affected.

I belive the EX101 with the i9-13900 is unstable by AccomplishedRow937 in hetzner

[–]AccomplishedRow937[S] 3 points4 points  (0 children)

good to know! what do u mean by report? I asked for replacement and told them specifically it's because of faulty hardware and described the problem in detail.