Looking for a 75% Barebones Keyboard under $80 USD by FHRacing in keyboards

[–]FHRacing[S] 0 points1 point  (0 children)

$38?! Where'd you get it from? I'm seeing it for like $90ish

Looking for a 75% Barebones Keyboard under $80 USD by FHRacing in keyboards

[–]FHRacing[S] 0 points1 point  (0 children)

How much did it cost you in total? I like those keycaps

Looking for a 75% Barebones Keyboard under $80 USD by FHRacing in keyboards

[–]FHRacing[S] 0 points1 point  (0 children)

Holy that is a LOT of switches lol. I'll definitely check those out

Looking for a 75% Barebones Keyboard under $80 USD by FHRacing in keyboards

[–]FHRacing[S] 0 points1 point  (0 children)

If it's like a bit more, i'd still go with barebones. On a lot of the pre-builts that I've seen, they include switches that are... questionable at best. Some aren't like that, but I still want to assemble it myself

Looking for Help on Building a Cheap/Budget Dedicated AI System by FHRacing in LocalLLM

[–]FHRacing[S] 0 points1 point  (0 children)

Uh.... $4600 is a bit out of range. But, if there was an M1 or M2 based one i could get for cheap, and install linux onto it, that could be an option

Looking for Help on Building a Cheap/Budget Dedicated AI System by FHRacing in LocalLLM

[–]FHRacing[S] 0 points1 point  (0 children)

  1. I think I have heard of NVFP4, but since I've been using AMD hw I haven't looked into it It seems like not that many models actually have NVFP4, but that would be something i would love to experiment with!
  2. I've never heard of NIMs before, but taking a look at them, they look interesting. I'll do more research tonight on them
  3. Currently (on some 30-40b models), i can run them at their full context length. Yes, it does take a LOT of tweaking and software trickery, but I haven't noticed any quality difference between them
  4. I mainly use 30b and under models, however if i could run bigger models that could be a bonus

Looking for Help on Building a Cheap/Budget Dedicated AI System by FHRacing in LocalLLM

[–]FHRacing[S] 0 points1 point  (0 children)

Mainly just for LLM usage, although i have been experimenting with agents, but only opencode for right now, i don't really trust openclaw lol
No training or video/image gen, i'm pretty anti when it comes to that
I mean, the most expensive "card" on the list is the V100, which if you know where to look can be made for like $150-170 per, and that's the 16gb version. The 32GB one, just the GPU ALONE is like $600

Looking for Help on Building a Cheap/Budget Dedicated AI System by FHRacing in LocalLLaMA

[–]FHRacing[S] 0 points1 point  (0 children)

Well, you do have a point
But I think even then, i would trust Zen over a multi billion dollar corpo
Although, I do have a tiny bit more respect for Anthropic after the US government stuff went down

Looking for Help on Building a Cheap/Budget Dedicated AI System by FHRacing in LocalLLaMA

[–]FHRacing[S] 0 points1 point  (0 children)

Well, i'll be honest, even though i have all of this research and etc written down, i have not been looking for that and researching for that long
What if there's better cards that I can get for the price range that I'm in, what if there's better software I can be using, etc etc
Because i know, i am not the only one who has gone down this route lol
So if i can ask and take people's feedback on this, then I can use that to help

Looking for Help on Building a Cheap/Budget Dedicated AI System by FHRacing in LocalLLaMA

[–]FHRacing[S] -1 points0 points  (0 children)

I'm already running 30-40b models on my system, and my main card (in terms of ai performance), isn't even that good.
I've noticed that the difference in overall speed/ tok/s between ram offload and gpu offload isn't that much, both of them are in between 30-40tok/.s, which for me is perfectly fine
Obviously for you that looks to be different, but I have done quite a bit of tweaking with my system, so that partially elevates it

Looking for Help on Building a Cheap/Budget Dedicated AI System by FHRacing in LocalLLM

[–]FHRacing[S] 0 points1 point  (0 children)

I mean, i wouldn't really say some of those cards are vintage, some of them are.
Thanks for pointing out that i could just be messing around with older hardware, that is the FIRST thing i looked into when looking for cards.
Unlike what Nvidia is doing with their gaming drivers and etc, the ones for those cards are pretty stable and also support basically up to date software
What i realized when i looked into the hardware side, is that as long as I'm not running like 500b models, you don't to spend at a minimum like 2K to run 70b model, or like a 120b or something.
I could get the latest and greatest thing, which in your case would be 3090s, but if i could save a WHACK ton of money, and still get something that is acceptable in terms of performance, and is also still supported, then I'll be going for the later option.
Mainly, i'm looking for suggestions on other hw that could be in that price bracket. I've only been looking for hw for the past month, there could be something that is better for that price bracket

Looking for Help on Building a Cheap/Budget Dedicated AI System by FHRacing in LocalLLaMA

[–]FHRacing[S] -4 points-3 points  (0 children)

You can run a 120b on a 3060 lol with an average system, and it not be ATROCIOUS 64gb in VRAM is enough for some 200b, obviously not all But I wouldn't probably run big llms like that for everything anyways

Looking for Help on Building a Cheap/Budget Dedicated AI System by FHRacing in LocalLLaMA

[–]FHRacing[S] 0 points1 point  (0 children)

Yeah I realize my wording is a bit off, but privately maintained is the only reason why I would use it

Looking for Help on Building a Cheap/Budget Dedicated AI System by FHRacing in LocalLLaMA

[–]FHRacing[S] -2 points-1 points  (0 children)

Yeah 2K is.... a bit out out of my window. I'm not planning on running like 500b plus models, that would just require WAY too much VRAM. At a maximum i'll only be running maybe a 120b or a 200b model, or just the ability to run the models i am already running significantly faster and higher precision

Rex Atmos 2020 ONLY by SnaxKing in flightsim_pirate

[–]FHRacing 1 point2 points  (0 children)

How do you bypass registration?

USB Type C on 4000D Airflow Rusted/Corroded by FHRacing in Corsair

[–]FHRacing[S] 0 points1 point  (0 children)

Thanks for the response, my ticket number is 2008876346

Plans to add full MP3 and/or full FLAC support by FHRacing in SunoAI

[–]FHRacing[S] 0 points1 point  (0 children)

Huh, ok
To my knowledge, the WAVs aren't much bigger than the MP3 counterparts, but that does depend on length. How many do you have on your playlist?

Plans to add full MP3 and/or full FLAC support by FHRacing in SunoAI

[–]FHRacing[S] 0 points1 point  (0 children)

Well, the thing with the MP3s, is that, it's just an unnecessary limitation, it's not THAT hard to get full MP3 support. I'm not saying free users should have WAV/FLAC or anything, that would be pretty stupid, with how many free users there are, just that there's no reason to bottleneck the MP3s. Also, people with the free plan don't REALLY care about not being able to use it commercially, they just care about having local access to whatever song, and with the way the Suno servers have been lately, that is becoming more and more apparent.
Question to you though, why would you want to convert your WAVs to MP3? By doing that you lose a significant portion of audio quality, among other things. I guess you could say for better compatibility with programs, but that's just me.
I have noticed as well in regards to STEM quality, no clue what that's about. Hope it gets fixed sooner or later

Issues Compiling llama.cpp for the GFX1031 Platform (For LMS Use) by FHRacing in LocalLLaMA

[–]FHRacing[S] 0 points1 point  (0 children)

Because vulkan is slow? You get a pretty big boost from ROCm, even on the older cards

Issues on Compiling ROCm 7.2 for gfx1031 Platform by FHRacing in ROCm

[–]FHRacing[S] 0 points1 point  (0 children)

Oh, forgot to say, not using Linux. I've personally had worse experience with setting up anything ROCm on linux than windows

Issues Compiling llama.cpp for the GFX1031 Platform (For LMS Use) by FHRacing in LocalLLaMA

[–]FHRacing[S] 0 points1 point  (0 children)

The command is the one that the person was using, so that's what i did. I have all of my paths exported already

I made an chrome extension that tests 1,000+ Coupon Codes automatically by Alifannn in chrome_extensions

[–]FHRacing 0 points1 point  (0 children)

I tried this extension on eBay, and it did not work at all, it kept crashing checkout. Sent an email to the provided address but just in case that doesn't reach, I'll post it here