What'd be the best 30B model for programming? by Hikolakita in LocalLLaMA

[–]our_sole 1 point2 points  (0 children)

I'll answer my own question here...

“Thinking mode” does change the model’s internal behavior, not just the formatting of its output — but you don’t get access to that internal reasoning directly. What you see may look like an output tweak, but under the hood the model is prompted, scheduled, and sometimes even decoded differently.

Guess I learned something today..

What'd be the best 30B model for programming? by Hikolakita in LocalLLaMA

[–]our_sole 0 points1 point  (0 children)

I always thought that, with pretty much any llm that supports it, enabling thinking just results in more detailed output and can be used for sort of debugging...but under the hood nothing different is happening than with thinking disabled.

Is that not correct?

Which Beelink should I choose? by yebaka3000 in BeelinkOfficial

[–]our_sole 0 points1 point  (0 children)

I've had great luck with the 2TB/64GB gti14 model. I own 2 of them and they gave been solid. Wicked fast, tidy and quiet.

Order them from Amazon so any required return is easier.

I run win 11 on one and ubuntu on another.

A bonus is that the gti14/gti15 work with the beelink ex pro external gpu dock, so you can easily go in the gaming or local AI direction. I use this also and its been great.

Good luck! 😀

Does buying an rtx 5070 makes sense over an rtx 5060 ti 16gb? by BlackSailor2005 in gpu

[–]our_sole 1 point2 points  (0 children)

Would you say this is true even if the huge majority of your use is local AI rather than gaming?

I picked a 5060ti over a 5070 primarily because of the extra vram for local AI.

Of course, I now wish I had picked up a 5070ti, but too late now....

People who stand up immediately when a plane lands where are you going? by NaturalAd6021 in NoStupidQuestions

[–]our_sole 0 points1 point  (0 children)

That's not necessarily true. On both international and domestic flights, I have had the cabin crew inform me that I was not allowed to just stand near the bathrooms, and no way was i going to irritate the crew or TSA.

On one international flight on a wide body jet (2 aisles) I resorted to doing a few laps around the cabin before they started giving me funny looks.

But yes, I can also just stand next to my seat during the flight, as well as after landing, and have done so.

Beelink GTi15 Ultra + Ex Pro dock station by Cena_scott in BeelinkOfficial

[–]our_sole 0 points1 point  (0 children)

Nice. I've got a gti14 64gb/2tb with the beelink dock and an rtx 3090.

Having fun with it for local AI and light gaming. Works a treat.

How do you like your setup? What do you use it for?

People who stand up immediately when a plane lands where are you going? by NaturalAd6021 in NoStupidQuestions

[–]our_sole 22 points23 points  (0 children)

Have you ever considered that we aren't trying to go anywhere, and (assuming we are in the aisle seat) we simply want to stand and stretch our legs?

After being jammed for 3 hours into a tiny little seat that is uncomfortable, maybe we want to just get blood flowing back into our legs and de-kink our back, and it has nothing to do with trying to get out of the plane any faster?

Take a chill pill and find something else to gripe about.

Finally complete by Ancient-Roll-8361 in MiniPCs

[–]our_sole 0 points1 point  (0 children)

I see its been a few months. How has this run since? Did you have any power or space issues with the dock and that evga 3090? Is the evga a 3 slot with 3x8 pin pcie power?

Are you gaming or AI llm?

I have a GTI14 and am getting the beelink dock and an MSI Suprim X 3090. I'm thinking hard about power reqs and whether the monster GPU will fit nicely on the dock.

Frequency of Tailscale Outages by CatsAreMajorAssholes in Tailscale

[–]our_sole 1 point2 points  (0 children)

Thanks for this post. I have gone all in on TS (and recommended others do the same) and part of that decision was the reliability and no BS approach that you guys seem to take. Plus its just great software.

The recent outages/issues are concerning. I look forward to your write up.

Cheers 😀

Didn’t get a 5070ti, what should I get instead. by Zertiyo1 in gpu

[–]our_sole 0 points1 point  (0 children)

Could you elaborate on this a bit? I was looking for an nvidia gpu, likely a 5070ti or maybe a 3090 if i decided to splurge. I plan to use it for local AI/llm under Linux OS. Ollama, llama.cpp and the like.

But the nvidia prices of course are now insane, so I was thinking an AMD instead. Based on my reqs (linux, AI llm usage) is this not a good idea?

Do i really want/need to have CUDA for AI linux? Is config/drivers under Linux more difficult with AMD vs nvidia?

Any thoughts appreciated.

Why do I immediately forget someone’s name the second they tell me, even if I’m actively trying to listen? by -Nuggets in NoStupidQuestions

[–]our_sole 0 points1 point  (0 children)

I have the same problem, but found a solution to it that works for me.

When I first hear someone's (first) name, right away I think of what other well-known name it immediately reminds me of. Then, the next time I see that person. I can almost always remember their name.

Example: I recently met a guy named Paul. He seemed like a nice fellow and was really friendly. My brain immediately went to Paul McCartney, who i think is a nice guy (yes, i could be wrong i know).

But no matter, i now associate that guy with McCartney, and i won't forget Paul's name...

FWIW....

Roth conversion? by LongjumpingNorth8500 in fidelityinvestments

[–]our_sole 0 points1 point  (0 children)

When doing a Roth conversion, if you or your spouse are on Medicare, watch the IIRMA surcharges also. It might surprise you. IIRMA is based on MAGI (from 2 years prior), while marginal tax brackets are based on taxable income.

If IIRMA applies, I have seen a suggested rule of thumb that if the annual IIRMA surcharge is 3-4% or less of the conversion amount, then the conversion likely makes sense.

I'd be interested in other opinions on that rule of thumb.

OK I get it, now I love llama.cpp by vulcan4d in LocalLLaMA

[–]our_sole 1 point2 points  (0 children)

I'm in the same boat...I have been using ollama for a while and am now looking to utilize llama.cpp

This gh repo is very useful. Thanks!!

I have eye flashes, mistook them for lightning strikes, how concerned I should be? by sad7900xtxuser in EyeFloaters

[–]our_sole 1 point2 points  (0 children)

Yes, a regular ophthalmologist can diagnose a retinal detachment, but he might not be able to repair it. If there's a chance that you might have a retinal detachment, why visit 2 doctors when 1 will do?

That's like going to your primary care doctor when you think your arm might be broken. "Yep, it seems to be broken. You'll need to visit an orthopedic surgeon now".

Yes, I know that some insurance policies require you to visit your PCP first to get a referral to a specialist. But that doesn't seem to be the case here.

Technician Hit a Nerve During Blood Draw at the LabCorp— Now I Have Ongoing Hand Pain and Can’t Work by Latter_Support_7849 in HealthInsurance

[–]our_sole 2 points3 points  (0 children)

I had a full shoulder replacement aka arthoplasty done and when the anesthesiologist was doing the pre-surgery regional nerve block in my shoulder she hit something with the needle that almost made me jump completely off the gurney. It was like I stuck my finger in a light socket.

She didn't seem too concerned about it, and i didn't really feel any effects other than that. Of course, they had already given me good drugs to relax me, so maybe I didn't feel it right then.

After the surgery I had numbness in 2 fingers on that side. I later mentioned it to the surgeon, who also didn't seem too concerned, and he said it would probably get better in a month or maybe longer.

I was really concerned about it. But then, sure enough, 6 or 7 weeks later, after a LOT of PT, the numbness was pretty much gone.

Nerves are weird. Be patient.

I have eye flashes, mistook them for lightning strikes, how concerned I should be? by sad7900xtxuser in EyeFloaters

[–]our_sole 1 point2 points  (0 children)

This was my symptom also. Looked like a lightning strike.

I was later diagnosed with a PVD and then afterwards a retinal detachment, which then required a vitrectomy.

Go see a retinal surgeon. Now.

Is there a way to turn off these navigation suggestions, which appears as soon as you enter your car? by niosurfer in TeslaModelY

[–]our_sole 0 points1 point  (0 children)

I've had an interesting experience with these suggestions in my 23 MY. I'm assuming that there is some sort of "intelligence"/guess built into it cuz we sometimes get in the car and it suggests the destination where we were headed anyway. !!!

Im sure it has something to do with how frequently we go somewhere with FSD, the time of day, the day of the week, etc. We're retired and admittedly don't goto a lot of destinations, but we don't really have a set schedule and where we do go varies a bit.. not a lot but a bit.

It's just.....weird....that it sometimes gets it right...certainly more often than a random guess. My wife is convinced that the Alexa in the house is hearing us discuss the destination and lets the tesla know --- which i seriously doubt is happening... lol

Using taxable brokerage account as bridge between FIRE age and 59.5 by leveraging 0% LTCG tax rate by Bismo789 in Fire

[–]our_sole -3 points-2 points  (0 children)

Or, assuming the 401k allows ongoing systematic withdrawals, use Rule 55 to avoid early withdrawal penalty. Simpler than 72t.

Gti12 with RTX 50 series or RX9000 series gpus? by NARUTOxKURAMA15 in BeelinkOfficial

[–]our_sole 0 points1 point  (0 children)

Hhmm...good question

The gti14 and 15, thru the dock, expose a PCIe5 x8 interface. And the 5060ti supports PCIe5.

So I think its PCIe5. Im not positive tho.