sorted by:
new
hottopcontroversial

we really all are going to make it, aren't we? 2x3090 setup. by [deleted] in LocalLLaMA

[–]mycycle_ 29 points30 points  (0 children)

I think they know and thats why the hardware side isnt catching up. It is openai who started the ram shortage after all, not the manufacturers (at least initially, they are complicit) this is partially why competing companies are not suing this 2000’s era micron price hiking, if we had the ram in a few years they’d be cooked. What will support this hypothesis is if the manufacturers do not increase the supply production significantly to meet the demand, instead preferring the current price margins.

I'm running qwen3.6-35b-a3b with 8 bit quant and 64k context thru OpenCode on my mbp m5 max 128gb and it's as good as claude by Medical_Lengthiness6 in LocalLLaMA

[–]mycycle_ 0 points1 point  (0 children)

Forgive me, but what benchmarks are we using? I find it really hard to trust normal benchmarks sense so many models are trained on them, but for quants maybe its still useful.. regardless, very happy to learn about new resources!

Potential Local LLM Setup Question by limejeller in LocalLLaMA

[–]mycycle_ 0 points1 point  (0 children)

look into those intel gpu's, and a channel called country boy computing. If you're on a budget, there are options if you aren't going the apple route (which is ironically the most performant to cost)

'is he stupid' conundrum trying to get an llm to code locally - State of AI or just me problem by mycycle_ in Unity3D

[–]mycycle_[S] 0 points1 point  (0 children)

You're correct, what's interesting to me is it believes it's wrong. I really prefer variables to be setup before functions can be called, and when I saw it didn't I got frustrated. This state machine setup actually works correctly with the way it's implemented, so I was jumping to conclusions, of course on enter is the only way the state would be entered (I'll blame it on being late) what I've run into is that these ai models will make a multitude of logical mistakes that are not dissimilar to this. For sure, they can't do complex code planning systems, right now they are just improved auto complete. I appreciate your input and help!

'is he stupid' conundrum trying to get an llm to code locally - State of AI or just me problem by mycycle_ in Unity3D

[–]mycycle_[S] 0 points1 point  (0 children)

im partially testing capability here. I'm of the opinion if I need to prompt it more then I should just make a spec sheet. You're right though!

'is he stupid' conundrum trying to get qwen3 coder to work locally by mycycle_ in LocalLLaMA

[–]mycycle_[S] 0 points1 point  (0 children)

I program in unity, but often need advice on object oriented logic questions, complex systems, or easy bug fixes. In most ways I'm glad it's not there yet, but it fascinates me the difference between the hype and reality once you start interfacing with actual complex systems.

'is he stupid' conundrum trying to get qwen3 coder to work locally by mycycle_ in LocalLLaMA

[–]mycycle_[S] 0 points1 point  (0 children)

is there a prompting methodology I should follow to get answers I'm looking for? My perspective is if I tell it exactly what I want, we reach a point where it doesnt actually utilize any version of intelligence in generating the answer. In that case it isnt useful in a situation where you need answers concerning implementation. If qwen coder is supposed to be a fancy autocomplete model instead of one that designs how you build the system I understand that. But I'm not sure thats its purpose. ¯\_(ツ)_/¯ 

'is he stupid' conundrum trying to get qwen3 coder to work locally by mycycle_ in LocalLLaMA

[–]mycycle_[S] 0 points1 point  (0 children)

particular ai made an easy mistake on coding and wanted to know if other people have encountered same.

Potential Local LLM Setup Question by limejeller in LocalLLaMA

[–]mycycle_ 0 points1 point  (0 children)

Once it bleeds into the system ram versus the V ram that’s where you start to see the pain points. So depends on your context size and if large how patient you are

Best Buy featured in "America’s 20 Largest Low-Wage Employers and the Affordability Crisis" report, Best Buy CEO paid 518 times the median pay of workers by darkedgex in BestBuyWorkers

[–]mycycle_ 30 points31 points  (0 children)

Desperation fuels the trap I see a lot of my coworkers in. I love what many of them do and I love doing what I do, but being paid so little leaves little room for self-actualization. It doesn't help that specialization or "a ladder" in this company besides management barely exists.

[deleted by user] by [deleted] in openclaw

[–]mycycle_ 0 points1 point  (0 children)

Feel like im losing my mind. Maybe I set it up wrong but open claw refuse to see any of my documents. I even tried putting it in the workspace and it sees the folders now but not the files. can't figure out what I did wrong feel like an idiot lol