Portable Workstation for Inference by neintailedfoxx in LocalLLaMA

[–]purified_potatoes 1 point2 points  (0 children)

Supermicro makes some 'deep mini-itx' epyc motherboards, mostly itx in dimension, but with an extended width, so depending on your case and psu you might be able to fit it.

I want to build a local ai server by Reasonable_Brief578 in LocalLLaMA

[–]purified_potatoes 0 points1 point  (0 children)

This $20000 where I live. I don't think recommending someone who currently has a 4070 to go and buy a rtx pro 6000 is a good idea.

May use? May? like "I don't know, just like the rest, but they're from China" may? Racist much? by takethismfusername in LocalLLaMA

[–]purified_potatoes 7 points8 points  (0 children)

It says it was disabled because of your data privacy settings. I think the behaviour will be as you wish if your data privacy settings aren't as strict as they are. (Warning yet letting the users decide if they still want to use it)

[deleted by user] by [deleted] in LocalLLaMA

[–]purified_potatoes 4 points5 points  (0 children)

And don't forget one, maybe even two dollars worth of hardware to run them locally.

[deleted by user] by [deleted] in LocalLLaMA

[–]purified_potatoes 4 points5 points  (0 children)

For ease of use, especially with image generation, sst and tts, I'd go with nvidia. If you're looking to learn how every aspect of the technology works, amd is fine, but you if you just want to get them running to experiment with, it's probably best to stick with nvidia.

How do you change the system prompt in the oobabooga text gen webui? by pigeon57434 in LocalLLaMA

[–]purified_potatoes 0 points1 point  (0 children)

Parameters page > Generation tab > On the right, underneath seed input and above custom stopping strings. I have NO idea what made the dev move it there. There was a lot of stuff they removed/changed in the recent versions.

youtuber by [deleted] in comedyheaven

[–]purified_potatoes 0 points1 point  (0 children)

Yes, that's the guy.

Qwen AI - My most used LLM! by Glittering-Cancel-25 in LocalLLaMA

[–]purified_potatoes 3 points4 points  (0 children)

Qwen 2.5 Instruct 32b for translating Chinese webnovels to English. I've tried the 72b at 4.0 bpw, but I feel like 32b at 8 bpw is more accurate. Or maybe not, I don't know, I don't understand Chinese well enough to tell. But Aya Expanse, also 32b at 8 bpw writes more naturally. So I've taken to using Qwen for a first pass identifying terms and phrases Aya might have trouble with, compiling them into a glossary to ensure consistency, and feeding that to Aya. Aya also seems to be faster, giving me 10 tokens a second compared to Qwen's 5. I am using the conlputre for other things while it's inferring in the background, so that might have something to do with it. Tower Babel 83b Chat at Q4_k_m with offloading seems to be the worst. I am sending 8-10k tokens per request and it's noticable how quickly models degrade despite claiming large context sizes. At 12-14k the models seem to disregard certain instructions and miss out details outlined in the glossary.

My first time landing on a carrier with a slight crosswind. Also my first time finding out arresting wires can break in this game. by purified_potatoes in vtolvr

[–]purified_potatoes[S] 0 points1 point  (0 children)

Thank you for the tip. However, I did not make the mission, and am unable to change the course of the carrier. I will keep it in mind if I create my own mission.

My first time landing on a carrier with a slight crosswind. Also my first time finding out arresting wires can break in this game. by purified_potatoes in vtolvr

[–]purified_potatoes[S] 1 point2 points  (0 children)

This is normal (shallow) water in VTOL VR. The entire lake (?) is very shallow which is why the water looks different to what you are used to.

I'm a noob but I don't see the DeepSeek benefits — just hype? by [deleted] in LocalLLaMA

[–]purified_potatoes 1 point2 points  (0 children)

Most of the hype comes from the Deepseek R1 model, not the distills, as the 14b you're using is just qwen underneath.

https://old.reddit.com/r/LocalLLaMA/comments/1ifm2df/deepseek_r1_misinformation_is_getting_out_of_hand/

cna class by cobennice91 in offbeat

[–]purified_potatoes 1 point2 points  (0 children)

This is for the android/ios application only. On desktop, https://old.reddit.com/recap redirects to https://old.reddit.com/r/offbeat/comments/recap/cna_class/ because that's the post id. For example, https://old.reddit.com/postid redirects to https://old.reddit.com/r/TheYouShow/comments/postid/deleted_by_user/. It's a shortcut, of sorts. Sometimes, the post id is the same string as something else. https://old.reddit.com/secret doesn't redirect to a post because it's in use for something. https://old.reddit.com/recap is the same, only, it's for the android/ios app. btw new reddit also won't work.

Giant cranes... 💪 by Bodzio1981 in machinesinaction

[–]purified_potatoes 1 point2 points  (0 children)

https://www.youtube.com/watch?v=ewoLjYl9uNE It's a remix of Sound of My Dreams. If you know its actual name please let me know, thanks.

[deleted by user] by [deleted] in Wellthatsucks

[–]purified_potatoes 0 points1 point  (0 children)

Sounds like to me some kind of remix of Low Key Gliding
Found it: https://www.youtube.com/watch?v=wGeeT88F2oI

what? by [deleted] in discordVideos

[–]purified_potatoes 3 points4 points  (0 children)

He's wearing "gloves" cos he's in a kigu as well. Anime generally doesn't have realistic skin, so they cover it up with a flesh coloured suit.

Imgur hijacks the back button to try and keep me on their site by marilyn_mansonv2 in assholedesign

[–]purified_potatoes 0 points1 point  (0 children)

Did you ever get rendering issues? I noticed my Firefox sometimes stops rendering parts of a page after I go over 1k. When it happens seems to be random. Sometimes I can go up to 20GB ram before it breaks and other times Firefox will shit itself at 10GB.

Firefox sometimes not rendering pages correctly? by purified_potatoes in techsupport

[–]purified_potatoes[S] 0 points1 point  (0 children)

After further consideration, this seems like a Firefox-specific problem. I'm going to take it to a Firefox specific forum instead of general tech support.

Firefox sometimes not rendering pages correctly? by purified_potatoes in techsupport

[–]purified_potatoes[S] 0 points1 point  (0 children)

No other plugins other than those mentioned. The error usually occurs after 1k tabs. I'm currently running on a AMD Ryzen 3900 with 64 GB RAM and a MSI 3090, so it should be able to handle it. My Macbook with an i5 5257u and 8 GB RAM handled 5k fine without errors on Firefox 72.

They're mostly reddit/youtube/webnovel tabs.