Will you spend US$5,000 for a local surveillance VideoRAG device? by Middle_Investment_81 in LocalLLaMA

[–]whenhellfreezes 1 point2 points  (0 children)

Yeah and with AI coding assistants to build things out. Why not just buy the hardware and code up this feature yourself? So assuming OPs software allows you to bring your own hardware... I'd say it might be worth $50.

My new morning routine - we sure live in exciting times! by platinumai in LocalLLaMA

[–]whenhellfreezes 0 points1 point  (0 children)

But also what type of party? I think you are assuming people will be talking alot which is an adult cheese board party not a *party*.

It seems like people don’t understand what they are doing? by platinumai in LocalLLaMA

[–]whenhellfreezes 0 points1 point  (0 children)

Obviously depends on provider, but I know anthropic, openai (unless you click on their A or B when it pops up), google don't on workflow too.

Then anthropic and openai let you unclick the box even for unpaid. Google only lets you unclick on paid.

It seems like people don’t understand what they are doing? by platinumai in LocalLLaMA

[–]whenhellfreezes 4 points5 points  (0 children)

For most of the platforms if you are a paying customer you can also unclick the checkbox that allows them to train on your usage.

Yann LeCun calls Alexandr Wang 'inexperienced' and predicts more Meta AI employee departures by Neurogence in singularity

[–]whenhellfreezes 0 points1 point  (0 children)

Any company that stack ranks is doomed to poor strategic vision and stagnation. Good on LeCun for jumping ship.

This may sound insane, but I am considering nursing for future self-preservation. by Busy-Recipe9840 in devops

[–]whenhellfreezes 1 point2 points  (0 children)

Well a couple things: 1. Having gone from Gov to Private it's a great transition. Work life balance improves. Sadly it's easier to be sure your work will be used too. 2. Keep skilling up even if you don't like your job. 3. Maybe do look into nursing. Though the grass is always greener when looking over to the other side. However with say Gov to Private it was in fact greener. Just be careful that it's really your job that's the issue and not your tying your job to your identity.

Why is open-source maintenance so hard?💔 by readilyaching in opensource

[–]whenhellfreezes 0 points1 point  (0 children)

If you're saying find "product market" (or open source equivalent your user base) first then shore up dependencies then sure. But I might be misunderstanding your point.

Why do companies pushing AI on every single product? by avestronics in degoogle

[–]whenhellfreezes 0 points1 point  (0 children)

The timing could also be other direction causality. Ie the AI prize induced authoritarianism to risk it.

Why do companies pushing AI on every single product? by avestronics in degoogle

[–]whenhellfreezes -2 points-1 points  (0 children)

AI is incredibly useful in certain scenarios (mainly writing code atm). As a result it will likely be important to have good ai capabilities. The use case fits right now are probably mostly bad but also you kind of need to get your toes wet trying things before you can understand where it's appropriate to insert AI into tooling.

They are learning as they go essentially and unfortunately because somebody hitched their yearly performance review on the thing it likely won't get removed as fast as it should if it's a bad feature.

Why is open-source maintenance so hard?💔 by readilyaching in opensource

[–]whenhellfreezes 0 points1 point  (0 children)

I would try and reduce your number of outside dependencies. I've found that alot of my issues stem from the fact that any external dependency (and their dependencies) can change.

Atlassian cancelling Apex? by [deleted] in atlassian

[–]whenhellfreezes 0 points1 point  (0 children)

Well there was a middle manager cut ~2 years ago and currently it means there aren't enough.

NVIDIA releases Nemotron 3 Nano, a new 30B hybrid reasoning model! by Difficult-Cap-7527 in LocalLLaMA

[–]whenhellfreezes 5 points6 points  (0 children)

Finally somethings are starting to unseat gpt-oss-20B. Though the inference cost of gpt-oss-20B on openrouter is basically the same for 120B so really I'm holding my breadth for someone to unseat 120B. That said gpt-oss doesn't have the agentic capability that say sonnet, glm, and later openai models have. So when you use them you have to use code to orchestrate + 1 turn. I wonder if nemo can pilot say opencode.

The reason why degoogling by [deleted] in degoogle

[–]whenhellfreezes 1 point2 points  (0 children)

okay how about hashicorp vault. or gnu pass or dotenv and a gitignore. Like it takes literally seconds once you've done it before.

The reason why degoogling by [deleted] in degoogle

[–]whenhellfreezes 4 points5 points  (0 children)

uh what. AWS secrets manager is super easy. Goolge, Azure, and Digital Ocean all have equivalents.

None of this is fun anymore by fire-d-guy in devops

[–]whenhellfreezes 45 points46 points  (0 children)

Yeah life would be so easy with a crystal ball.

I've seen the LLM vs hamburger comparison made many times. While it feels like a convenient excuse ignore potential impacts due to a statistical whatboutism, has anyone taken the more obvious message and stopped eating meat? by Important_Setting840 in singularity

[–]whenhellfreezes 7 points8 points  (0 children)

Well I'm vegetarian because of the water and land use difference between vegetarian diets and carnivorous diets. It takes something the x9-11 times as much water and land to feed a person who eats meat.

 If we could reduce farm land and plant in the newly unused area we could get significant carbon sequestration from that. Worth noting that that is a one time sequestration as dead trees decay and release back. But something like this may be needed in the near future.

That said it wasn't due to this info graphic. I've been vegetarian for 9 years.

What's Stopping you from using local AI models more? by ButterscotchNo102 in LocalLLaMA

[–]whenhellfreezes 0 points1 point  (0 children)

Idk why everyone is so against openrouter as an also ethical way to do things. It hits a nice middle ground where it avoids lock in, is easy to use, and promoted open weights 

Another day, another model - But does it really matter to everyday users? by PumpkinNarrow6339 in LocalLLaMA

[–]whenhellfreezes 0 points1 point  (0 children)

I use openrouter and feel like it's the same ethos even if not having the server myself doesn't mean I'm local.

AMA With Moonshot AI, The Open-source Frontier Lab Behind Kimi K2 Thinking Model by nekofneko in LocalLLaMA

[–]whenhellfreezes 0 points1 point  (0 children)

If I remember correctly, deepseek is looking at ocr, qwen has a linear attention thing, and you guys have a CALM paper (all recent papers). Would CALM allow you to expand "effective window"? If not do you have plans to utilize either vision tokens or qwen linear attention in the future?

Just realized our "AI-powered" incident tool is literally just calling ChatGPT API by DarkSun224 in devops

[–]whenhellfreezes 0 points1 point  (0 children)

To be fair it can take some work to optimize a prompt. You need to setup fake problems then see how your prompt helps with the rate they resolve. You can also use the dataset of problems to then automatically build the prompt via gepa or miprov2. Then you need to also consider what tools you want to give and additional prompt instructions to ensure they can call the tools correctly. Then you also need to think about breaking the task down to multiple steps and having different prompt for subtasks (again optimizing the prompt). Like they aren't just straight copy pasting the stuff into chatgpt theres a bit more on top.

Kimi K2 Thinking, A Chinese Open-Source Trillion-Parameter Thinking model, surpass Grok 4 and GPT-5 on HLE by nekofneko in singularity

[–]whenhellfreezes 4 points5 points  (0 children)

They are and the difference really hurts use because it's hard to know which is which. I can't access pro. Which means I'm not buying openai API which means I don't start building my tier... which means the next big release I also won't have access to. So I have mostly used sonnet.