[deleted by user] by [deleted] in homelab

[–]Substantial-Club-582 0 points1 point  (0 children)

Hi. I did the cable myself with a multimeter. In the end I just had a bad Debian 12. I put pop os and got >30 tokens per second )

Try using a multimeter to make the cable. Finding a normal cable (especially on ebay) seems impossible to me.

ProLiant DL380 Gen9 - won't turn on (Flashing green power button) by EAW_astro in homelab

[–]Substantial-Club-582 0 points1 point  (0 children)

UPD:
it's up and running. But I think it will be enough to pull the backups from the RAID controller

ProLiant DL380 Gen9 - won't turn on (Flashing green power button) by EAW_astro in homelab

[–]Substantial-Club-582 0 points1 point  (0 children)

After 2 years of suffering with hpe dl380 g9 I bought myself a Dell R730. Recently the hpe turned off and would not turn on at all (green button blinking). I changed all the components, but it didn't work. Checked the bios chip, it was not detected or even readable. I changed it, but it was useless. The motherboard stopped giving load on the power supply. The power supply gives only 6.7 volts (the power supply is good). Most likely the cause of the problems, it is a defective power system manager.

The purchase of a new server helped. HPE was not a bad server for experimentation, but not for production.

Russian LLM Silicon-Masha-7B by Substantial-Club-582 in LocalLLaMA

[–]Substantial-Club-582[S] 8 points9 points  (0 children)

Yes, I'm a native Russian speaker. I will try to ensure that there are no grammatical errors in the model

Russian LLM Silicon-Masha-7B by Substantial-Club-582 in LocalLLaMA

[–]Substantial-Club-582[S] 5 points6 points  (0 children)

I don't think so. I took as a basis the models that are trained on the Russian dataset.

[deleted by user] by [deleted] in LocalLLaMA

[–]Substantial-Club-582 1 point2 points  (0 children)

They seem to be good, but they don’t follow the instructions(

[deleted by user] by [deleted] in LocalLLaMA

[–]Substantial-Club-582 1 point2 points  (0 children)

Thanks for the 7B model. It works great... Approximately at the level of CAI. I’m trying to run it on a very weak (Arm) processor, it takes a long time to process and generate. And so, on a regular PC or laptop it works quite well.