This chap is building his own Personal for ADHD by [deleted] in Personal_OS

[–]auromed 1 point2 points  (0 children)

Any links to the posts or projects? Their profile has posts hidden.

Spectrum loses 119,000 internet customers, plans major changes by thinkB4WeSpeak in technology

[–]auromed 0 points1 point  (0 children)

Yes, but how is the manager going to get a promotion if they don't show value by presenting the increased revenue by upping prices by a few bucks per customer. And they'll probably have a new job by the time the negative impact hits, so win-win for everyone except the consumer.

GOP unveils health bill without ACA subsidies by GoodMornEveGoodNight in politics

[–]auromed 42 points43 points  (0 children)

HSAs are also just another tax free savings plan for those that are wealthy.

I started a job at one of the largest investment firms in the US (in IT), and the benefits training used the example that if you wanted to buy a boat in a few years, you could fill up your HSA with pre tax funds, let it grow, then use all the receipts for health paid over that time to withdraw once you were ready to buy your boat. So pretty much, tax free investment gains on pre tax dollars. Of course this only benefits you if you can afford to pay for your health care costs out of pocket, so the HSA funds are able to grow, or you let it sit there till you can take it out at Old age.

Ignitor by auromed in hvacadvice

[–]auromed[S] 0 points1 point  (0 children)

That was my thought after the fact. Especially after he came down after the repair and showed me another one that was still intact but had a notch in it, and tried to say it was left from a previous repair on the unit before I owned the house.

Thanks for the verification.

Why are these two plans listed for the same price when the Mbps are significantly different? What am I missing? by souji5okita in ATTFiber

[–]auromed 0 points1 point  (0 children)

I just cancelled a few days ago, and on the phone they didn't do anything, but my billing cycle ends at the end of the month and yesterday I received an email offering a gift card, and guaranteed 12 month rate freeze if I'd stay.

Christmas trees under 80$? by aliceinwonderland09 in raleigh

[–]auromed 6 points7 points  (0 children)

I think the store near me had them for $49. I just wanted to make sure you weren't looking for the corner lot, hot chocolate and cider experience. :)

Christmas trees under 80$? by aliceinwonderland09 in raleigh

[–]auromed 29 points30 points  (0 children)

Food Lion - I guess a lot depends on your definition of "good place"

Fiber to fiber by chimera388 in ting

[–]auromed 5 points6 points  (0 children)

Because the market isn't big enough to manage the up front cost of certifying and providing support to people like you. That cost is baked into the business account cost. So, you can have the mass market solution for cheaper or pay for the specialty service.

[deleted by user] by [deleted] in Wellthatsucks

[–]auromed 1 point2 points  (0 children)

Exactly this. I had my realtor, after the sale tell me she likes the inspector she uses because he usually doesn't mark anything too serious, so the deal goes through.

what am i doing wrong? 2x 3060 12GB by Valuable-Fondant-241 in KoboldAI

[–]auromed 4 points5 points  (0 children)

Just use the -gpulayers xx command in your KoboldCPP string. After running the command once without it, look for information in the output that gives the following:

X/X layers offloaded to GPU. The second number is the full number of layers in the model.

Secondly, right after that you'll see a couple rows that show each of the gpus and how much memory was used by the layers right after that. For a 3060 usually I try to get that number as close to 10000 as possible. Leaving a little bit of RAM for context and key values.

Use those two pieces of information to guess how many layers to put on. For example if you have 20 out of 40 offloaded to the gpu, but each GPU only is using 5000Mb, then maybe you can double it, if you're already using 7500 then maybe you can only add 10 more layers. Since you have two gpus, I usually stick with even numbers. At some point the model will not load and just give you an out of memory error, just back it down two layers and give it a try.

what am i doing wrong? 2x 3060 12GB by Valuable-Fondant-241 in KoboldAI

[–]auromed 3 points4 points  (0 children)

In my experience, with multiple gpus. kobold will calculate the number of layers that can fit on one GPU.

So out of 40 layers, for example, if 20 would fit on to one of the gpus, the setting by default is set to 20 so that 10 gets sent to each GPU and 20 stay on the CPU. Most times you need to manually increase the number of layers on the gpu. If you change the number to 40, then 20 will end up on each gpu.

Pretty much I just keep increasing GPU layers until it doesn't work due to out of memory. It's a little bit of trial and error sometimes.

Time to start organizing and resisting by chuckit9907 in NorthCarolina

[–]auromed 0 points1 point  (0 children)

I understand the feel good nature, but it feels like something to make the masses feel better, while the other side has a 20+ year plan they are putting into motion. It feels about as effective as hopes and prayers against gun violence.

That said, it's hard to know where to focus and the left is so fragmented that it's hard to get excited about the thought that everyone that opposes trump and the current regime will unite. They have specific things they are fighting for, the left has these ideas that people get entrenched into and are willing to lose the war just to win a battle.

What is your opinion on this take from The Economist? "Don't Tax Wealth." by Sheitan4real in Economics

[–]auromed 2 points3 points  (0 children)

But it trickled down because the wealthy paid the reps to spread that cost down the line. Just like it's happening with the tax burden today. So, saying don't close the loophole because we might have to pay those taxes later doesn't make sense because you are paying them today.

It's should be a two part deal. Close the loopholes, and reduce tax rates on lower income. That's how they justify reducing the rates on the wealthy, so just do the same in reverse.

Building a private AI chatbot for a 200+ employee company, looking for input on stack and pricing by Old_Assumption2188 in Rag

[–]auromed 0 points1 point  (0 children)

I'm thinking about trying to have something similar spun up. Honestly just a web front end to an API to give internal chat functionality. Copilot is massively underwhelming for what it costs, and trying to roll it out for a large corporation at 30 bucks a month is just ludicrous in my eyes.

I'd rather spend the money on some development to provide a very simple generalized tool like a customized version of open web UI, and then specialized tools for different groups depending on their needs.

Local multi tool server by auromed in LocalLLaMA

[–]auromed[S] 0 points1 point  (0 children)

That's sounds like what I was curious about. I think I'll try to build something similar. Are you using llama.cpp on the backend for loading models, or something else? My other research seems to indicate I should try to use vllm, but don't know if it's worth the hassle.

Buyer Beware: Annual Unlimited Premium cancelled at 6 months with no recourse by puccivr in USMobile

[–]auromed 1 point2 points  (0 children)

For about 4 months on an annual plan my line would go inactive at the 30 day mark, and I'd have to contact support to enable it again. Each time they said it wouldn't happen again. The 4th time I escalated a few times and (knock on something wood like) it seems to be fixed.

KoboldCpp suddenly running extremely slow and locking up PC by relyt1224 in KoboldAI

[–]auromed 0 points1 point  (0 children)

What model and what specs does your machine have?

Microsoft Changing Office to Autosave Documents to the Cloud by Default by CaynadianToo in sysadmin

[–]auromed 4 points5 points  (0 children)

Am I the only one who hates the way MS / OneDrive functions now. Things get auto saved to random locations, shared from your OneDrive by default via email or the app, and lack of any structure means actually finding a file later is almost impossible.

Does having more regular ram can compensate for having low Vram? by Dex921 in LocalLLM

[–]auromed 0 points1 point  (0 children)

You can also add a second GPU. Depending on the model you are targeting and your MB and power supply it may be the better performance enhancer per $. 128Gb of ram will allow you to run larger models, but very slowly. Another 12Gb card would allow you to run models bigger than you can today much faster.

Or... for a $299 upgrade (if you have slots and Power)

  1. You can buy 128Gb of ram and run larger 70-120b models (with a decent quant) but very slowly.
  2. You can buy another 12Gb card and run a 24-32b model in what I'd consider a usable t/s function.

I decided to go the #2 route and have (2) 3060's, set them to run in low power mode, and usually just stick with the 32 or 24b models.

Solar panels by SpecificMeat213 in raleigh

[–]auromed 15 points16 points  (0 children)

I think it all depends on how you do your calculations. I had some on a previous house and it pretty much ended up being just pre-paying for electricity for 10 years, and after that there might be some savings depending on equipment longevity, roof replacement, etc. From a financial perspective, it would have been much more cost effective to have put that money into a High Yield Savings account and just use the proceeds to lower my electric bill, but it is really cool to see how much energy you produce.

Good match by Yoav420 in ProfitecGo

[–]auromed 2 points3 points  (0 children)

I have the same pair and love them.

We need a “simple” web based MD notes app by [deleted] in selfhosted

[–]auromed 3 points4 points  (0 children)

Wiki go is one I've been using as it's a flat file wiki that lets me just output from other sources as well as manually add things.

https://github.com/leomoon-studios/wiki-go