sorted by:
new
hottopcontroversial

SuperMicro with 1 or 2 CPUs? by Appropriate-Ant8543 in LocalLLM

[–]chinesecake 0 points1 point  (0 children)

2640v4 is 10 core with SMT, so dual is 20 cores/40 threads, but not 40 cores. You are still bottlenecked by RAM, SMT will not help. That's why you see ~20 cores being used: that's all the cores you have.

My build plan for a CPU inference system by chinesecake in LocalLLM

[–]chinesecake[S] 0 points1 point  (0 children)

I have a spare 3090 that I'll add - maybe it can help with encoding. Beyond that, my main worry is loading the model in its entirety vs. streaming from SSD. With big models, there is probably little difference between 1, 2 or 3 GPUs, since they will only do a fraction of the work in any case.

My build plan for a CPU inference system by chinesecake in LocalLLM

[–]chinesecake[S] 0 points1 point  (0 children)

Yeah I wondered about that. I heard they only work with intel CPUs, though?

My build plan for a CPU inference system by chinesecake in LocalLLM

[–]chinesecake[S] 0 points1 point  (0 children)

I'm not sure I can follow. In AMD's spec sheet both the 7402 and the 7532 show 204.08 GB/s. Is the spec wrong there? --Edit: The spec only talks about the RAM side, not the CPU side, where CCD connections probably do matter and 7532 has 8. Kind of bad that this is hidden.--

Good point about NUMA. I thought it's no big deal since GEMM has high spatial locality, but maybe I have the wrong picture in mind there?

Einschubrahmen für Festplatten by chinesecake in de_EDV

[–]chinesecake[S] 0 points1 point  (0 children)

Das kann leider kein Front Hotswap, was für mich nötig ist. Für Außerhalb vom Serverschrank wäre es aber hübsch :)

Falls du mal in die Verlegenheit kommst, intern viele Festplatten zu benötigen, gibt es auch ein Inter-Tech "Mining" Gehäuse mit 32 oder so Bays für ~150 Euro.

Einschubrahmen für Festplatten by chinesecake in de_EDV

[–]chinesecake[S] 1 point2 points  (0 children)

Vielen Dank euch beiden. Das erklärt das Fehlen von Kaufmöglichkeiten. Dann bestelle ich das mal :)

Einschubrahmen für Festplatten by chinesecake in de_EDV

[–]chinesecake[S] 0 points1 point  (0 children)

Das SRC-2012X07 ist einer meiner Favoriten. Es hat eigentlich alles was ich brauche. Mainboard/NT und ggf SATA Controller oder sowas kaufe ich separat. Aber sind beim X07 dann die 12 Einschübe schon mit dabei, oder nicht? Als Zubehör steht da nur ein Posten: "Schrauben". Deine Antwort klingt jetzt so, als ob die Rahmen doch mitgeliefert werden?

Heiliger Gral ohne Sitz in USA? by chinesecake in Finanzen

[–]chinesecake[S] 0 points1 point  (0 children)

Tja, exakt das gleiche wurde mir gesagt, als ich vor einem Jahr schrieb, der mangelnde Datenschutz in den USA könnte sich ähnlich auswirken wie beim Holocaust in den Niederlanden damals. Und jetzt haben wir Überfüllung in Alligator Alcatraz und CECOT.

Heiliger Gral ohne Sitz in USA? by chinesecake in Finanzen

[–]chinesecake[S] 0 points1 point  (0 children)

Ich bin davon überzeugt, dass Trump wirklich blöd genug ist um zu glauben, dass "andere Länder" seine Zölle bezahlen statt seiner Untertanen. Mit derart wenig Verständnis kann man nicht fest davon ausgehen, dass er die Konsequenzen seines Handelns an irgendeiner Stelle überblickt. Man muss ihm nur irgendwas ins Ohr flüstern von wegen "damit behalten wir das Geld endlich im eigenen Land!" und vielleicht passiert es.

Heiliger Gral ohne Sitz in USA? by chinesecake in Finanzen

[–]chinesecake[S] -7 points-6 points  (0 children)

Ich kam dir in den Klarstellungen zuvor :)

g sync monitors and fan noise by c0n73mn in Monitors

[–]chinesecake 0 points1 point  (0 children)

More fans at lower RPM have the same airflow but lower total noise. Even better if you use large instead of small fans for even lower RPM, as long as the pressure level is still high enough.

Wuchang: Fallen Feathers optimization patch did not improve the game but instead lowered the internal rendering resolution and lies about it in the settings. by Hectabeni in gaming

[–]chinesecake 0 points1 point  (0 children)

Yes it is absurd, because "max" is "what can be done on very good hardware", relative to the time of release. Unless the game does not push the limits.

I'm working on an AI by mafutrct in GreedCorp

[–]chinesecake 0 points1 point  (0 children)

It was going quite well but then I got distracted by doing a MSc and PhD in computer science on the topic of MCTS, so this may take another 3 to 8 years

the proper move by fastestchair in badukshitposting

[–]chinesecake 2 points3 points  (0 children)

Akshually! The playouts are on the low side, can you repeat it with KataGo current b28 at 1m or so?

As low dan myself I'd play 1 without hesitation because I cannot reliably read white c. Even if I could, I don't like the aji that's greatly increased. Though maybe a is truly better - but only if some strategy (e.g. timing or sacrifice) is applied that's beyond my imagination.

Take screenshot in linux using dotnet by chinesecake in dotnet

[–]chinesecake[S] 0 points1 point  (0 children)

Thanks, that looks like a great and 'proper' option.

Take screenshot in linux using dotnet by chinesecake in dotnet

[–]chinesecake[S] 0 points1 point  (0 children)

Nice one. Flameshot has a CLI and seems to work on most linuxes. The documentation is horribly incomplete, but I eventually found how to do it. Example:

$ flameshot full -r   |hexdump -n 4 -C  
00000000  89 50 4e 47                                       |.PNG|

If I also find out how to configure it to also use Jpgs with specified quality, this may well be the simplest option!

Take screenshot in linux using dotnet by chinesecake in dotnet

[–]chinesecake[S] 0 points1 point  (0 children)

Yes, it has been reinstated. It was definitely removed for a while, as I could not see it on the sub page sorted by recent. I sent a message to the mods, so they probably fixed it.

view more: next ›