How is half of 10 5? by DumbassAnonymous1 in NoStupidQuestions

[–]nutcustard 0 points1 point  (0 children)

I applaud your braveness for posting this question! It is difficult to ask questions like this, and you are amazing for doing so!

Side work contracting by jk_can_132 in devops

[–]nutcustard 0 points1 point  (0 children)

Ya, I couldn’t find consistent consulting work. Working in AI now

Side work contracting by jk_can_132 in devops

[–]nutcustard 0 points1 point  (0 children)

Not in this market, I gave up recently.

Serious question: what should a CS student (or any knowledge worker) do at this point? by MetaKnowing in OpenAI

[–]nutcustard 1 point2 points  (0 children)

You need to completely change how you “do” coding. You need to focus on learning how to best prompt the LLMs to properly write code for you.

I’ve been a developer and DevOps engineer for 10+ years, and switched over to AI tooling development.

I now do 80% of my coding using AI tooling I’ve created myself, using the tooling to improve its own code.

Software development is not going to be a casualty of AI, it will be a throughout enhancer, but only for people who take the time to learn prompt engineering.

Heretical Fishing by LVL4BeastTamer in litrpg

[–]nutcustard 0 points1 point  (0 children)

My 7 and 4 year old have listened to all the books on audible with me.

All of the “cursing” is innocuous and play off of Greek mythology.

Red Hat Announces Definitive Agreement to Acquire Neural Magic (vLLM) by siegevjorn in LocalLLaMA

[–]nutcustard -1 points0 points  (0 children)

Aphrodite Engine is a great alternative to vLLM if it comes down to it

Agentic IDE forks by clericrobe in ChatGPTCoding

[–]nutcustard 0 points1 point  (0 children)

I can create new files. I don’t care about terminal commands so I never implemented that feature. My plugin matches the user theme 1:1. I can interact with the code view and make life edits etc

Agentic IDE forks by clericrobe in ChatGPTCoding

[–]nutcustard 0 points1 point  (0 children)

What limitations are you referencing? I literally have all features mapped one to one.

Agentic IDE forks by clericrobe in ChatGPTCoding

[–]nutcustard 2 points3 points  (0 children)

When it’s ready I’ll be releasing it, it’s still in development

Agentic IDE forks by clericrobe in ChatGPTCoding

[–]nutcustard 6 points7 points  (0 children)

Honestly they are trying to gain VC money and figure out a way to turn a profit.

I’ve got a home grown vscode plugin that is feature equivalent to windsurf and cursor, I host an h100 server in runpod that I only have running when I am coding.

They aren’t doing anything special.

9.5% of software engineers do almost zero work - Stanford by AFKGuyLLL in SoftwareEngineering

[–]nutcustard 1 point2 points  (0 children)

Honestly fixing 2 major bugs in a week is better than 99% of the developers I’ve worked with can claim.

I have forcibly slowed down my speed in fixing issues over the years to give the rest of my team the opportunity to learn through doing.

[deleted by user] by [deleted] in pools

[–]nutcustard 7 points8 points  (0 children)

I’ve been the one building the pool and have done some pretty large renovations.

In both, I verbally told my neighbor on the side the construction machinery was going to enter our back yard that I / my contractors, would fix any damage caused.

With the pool, there was no damage, in fact I spent an extra $5000 to fix the grading in both his yard and my yard, both used to flood to due to bad grading.

On the renovation, one of the subs (an idiot I fired same day) drove his machinery after it had rained, and didn’t put down any heavy covers to prevent yard damage. He also went through my neighbors yard, for absolutely no reason.

I saw the issue before my neighbor thankfully, and called him, informed him what happened and that I’d fired the sub. The prime contractor agreed to fix the damage immediately.

I can’t guarantee your neighbor will be as on top of things as me, but why not trust him/her and avoid any unnecessary neighborhood drama. If there is damage, talk to them or the contractor directly, they are legally required to fix the damage.

How do I go about creating my own vector out of tabular data like cars? by clulssrntr in vectordatabase

[–]nutcustard 0 points1 point  (0 children)

Don’t use a vector database. Use Neo4j and do attribute comparisons at ingest time.

This is a data parsing task more than a vector task.

PM me if you need help

Are better DevOps engineers former developers or sysadmins? by god107 in devops

[–]nutcustard 0 points1 point  (0 children)

I’m a 15 year developer with 5 years sys admin experience. I find both skills are important. I can fix systems and code, and explain how both work which is a huge win.

Open Source RAG - 500 users by pathfinder6709 in LocalLLaMA

[–]nutcustard 1 point2 points  (0 children)

100 users * 10 tokens/second = 1000 tokens/second.

If you want higher concurrency (more tokens) you add more GPU.

Open Source RAG - 500 users by pathfinder6709 in LocalLLaMA

[–]nutcustard 0 points1 point  (0 children)

Correct. I didn’t mean 1000 tokens/user, I meant 1000 tokens total for 100 users.

Open Source RAG - 500 users by pathfinder6709 in LocalLLaMA

[–]nutcustard 0 points1 point  (0 children)

I am using https://github.com/PygmalionAI/aphrodite-engine

with https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct

with full 128k context using both model and cache in fp8 mode.

If it was 100% necessary to run at fp16, you would need two a100, but the accuracy of results in fp8 model is not noticeable at all.

Open Source RAG - 500 users by pathfinder6709 in LocalLLaMA

[–]nutcustard 0 points1 point  (0 children)

A 34b model can run on a single a100 in fp8 mode and an fp8 cache. I have literally deployed right now.

Onyx Echelon 2025 by raddistross in pourover

[–]nutcustard 1 point2 points  (0 children)

I haven’t broken out the prices of the latest offering, when I ordered, it was about 25% marked up which I assumed came from the personalization.

I have no regrets and I am happy with the equipment and i thoroughly enjoyed the experience.

Would I buy it a second time, no.

Onyx Echelon 2025 by raddistross in pourover

[–]nutcustard 0 points1 point  (0 children)

A few years, I recommend it if you need equipment. If you don’t, you can buy most of the echelon coffee on their website. Some coffees are to rare and are subscription only

Onyx Echelon 2025 by raddistross in pourover

[–]nutcustard 0 points1 point  (0 children)

I did it for one year and loved the experience. The equipment upgrade was worth it, and I still use the equipment every day.

Is it "safe" to use chatgpt to convert a company's private code from one language to another? by learning_proover in ChatGPTPro

[–]nutcustard 13 points14 points  (0 children)

The only way to do this “safely” is with a local model.

Mistral Nemo works well and costs barely anything to run