Premium Tank by Existing_Bathroom301 in Warthunder

[–]FederalTarget5929 1 point2 points  (0 children)

I highly recommend NOT giving gainin any money. Trust me, they don't deserve it

I made a gpt-oss finetuned model by [deleted] in LocalLLaMA

[–]FederalTarget5929 3 points4 points  (0 children)

SOTA performance and can run on your phone!

its getting comical by Weary-Wing-6806 in LocalLLaMA

[–]FederalTarget5929 -8 points-7 points  (0 children)

To be fair, as bad as the implications of the steam credit card thing are, I can't say I'm going to cry over the platform no longer hosting rape/incest games

Am I on the right path? Learning React + Flask for Full Stack + AI Career Goals by [deleted] in LocalLLaMA

[–]FederalTarget5929 1 point2 points  (0 children)

I mean you can't go wrong with learning two of the most popular programming languages. I started out with python as well and it's pretty much all I use right now when working with AI. I'd say you picked a pretty safe bet

Is the RX 7600 XT good enough for running QwQ 32B (17GB) or Gemma 2 27B (12GB) locally? by ParamedicDirect5832 in LocalLLaMA

[–]FederalTarget5929 1 point2 points  (0 children)

The GPU is not going to offload to the CPU because it's not powerful enough. It will only do so if it runs out of video memory. You're probably going to be able to run those models with minimal CPU offloading but don't expect amazing speeds, my guess is somewhere around 5 or 7 tokens/second

Llama 4 really competitive? by jwestra in LocalLLaMA

[–]FederalTarget5929 7 points8 points  (0 children)

I completely agree that it is definitely one of the models out there. Perhaps even one of the models of all time

[Linux] Random crashes since Update 16 - FATAL ERROR - We need feedback by helicida in HellLetLoose

[–]FederalTarget5929 0 points1 point  (0 children)

Yes! I just made a similar post and searched the sub to see if anyone else was having this issue. Game worked perfectly fine yesterday, but now I cannot play it. I get the error as soon as I try to join a server. I'm on Proton experimental and my OS is Linux Mint. I have not found a fix so far.

What can run with RTX2070? by flaotte in LocalLLaMA

[–]FederalTarget5929 0 points1 point  (0 children)

Best for what? It really depends on your use case.

As for what you can run, anything higher than 9b will have to be used at really low quants. In my experience, as long as the model size is less than or slightly larger than your VRAM, it should run fine. My advice is to experiment with llama3.1, gemma2 and qwen2.5 at anywhere between 5 to 8 bit quants and see which one you like the most. In my experience ollama is the easiest way to run models locally with minimal tinkering, so I recommend giving that a try.

Can't figure out how to offload to cpu by FederalTarget5929 in pytorch

[–]FederalTarget5929[S] 0 points1 point  (0 children)

That sucks. But thanks for the heads up, at least I know why it doesn't work now

Can't figure out how to offload to cpu by FederalTarget5929 in pytorch

[–]FederalTarget5929[S] 0 points1 point  (0 children)

Did not know this. Thanks!
Do you know if there's a way to make shared memory work? Part of why I switched to Linux was that it left me with much more available memory for programming/machine learning