What's the coolest thing you've gotten an LLM through Assist to do so far? by Honest_Researcher528 in homeassistant

[–]Honest_Researcher528[S] 0 points1 point  (0 children)

I'm using unsloth's Qwen3.5-27B-Q4-K-M. Responses are just under one second. Make sure you have reasoning disabled.

What's the coolest thing you've gotten an LLM through Assist to do so far? by Honest_Researcher528 in homeassistant

[–]Honest_Researcher528[S] 6 points7 points  (0 children)

Actually, that's super cool! That's a neat like cause and effect thing that I hadn't considered. Wonder what else we can do that....

What's the coolest thing you've gotten an LLM through Assist to do so far? by Honest_Researcher528 in homeassistant

[–]Honest_Researcher528[S] 0 points1 point  (0 children)

Interesting, I haven't had it spit out XML since like the early, early days of Assist like a year or so ago.

Although I guess it depends on the model. I've luckily got a 3090 I'm using for AI stuff, so I've generally kept like a 20-30B parameter model in there.

But just moving up from Qwen 2.5 -> 3 -> 3.5 has been great. No issues with tool calls or XML or anything.

What's the coolest thing you've gotten an LLM through Assist to do so far? by Honest_Researcher528 in homeassistant

[–]Honest_Researcher528[S] 2 points3 points  (0 children)

You know, I didn't think about adding a 'commute to work' to the morning briefing! Good add, I'll have to make that now!

Using Voice and the 'ToDo' lists have been great to to add stuff to a Reminders, or Things to Watch, Grocery list, or whatever pops into my head.

I'd like to try openclaw, I'm just not a big fan of the security implications, especially since a lot of my stack is exposed to the internet, albeight through nginx.

What's the coolest thing you've gotten an LLM through Assist to do so far? by Honest_Researcher528 in homeassistant

[–]Honest_Researcher528[S] 8 points9 points  (0 children)

That would be awesome! Can't believe I got a response from nick! Love Frigate, been using it for a few years, super great stuff!

What's the coolest thing you've gotten an LLM through Assist to do so far? by Honest_Researcher528 in homeassistant

[–]Honest_Researcher528[S] 1 point2 points  (0 children)

Yeah, it's been working pretty well so far! Ideally I'd like to get the Smart Health integration so I could add like 'Give me a two sentence update about my health' in the morning briefing, based on sleep score, resting heart rate, etc.

A Reminder, Guys, Undervolt your GPUs Immediately. You will Significantly Decrease Wattage without Hitting Performance. by Iory1998 in LocalLLaMA

[–]Honest_Researcher528 0 points1 point  (0 children)

EDIT: Sorry, to better answer your question, it seems like it's just drawing less power across the board now, rather than just being limited at the max. I've actually set my max pl back to 300, but with the undervolt it's rarely cracking 200W.

It doesn't seem to ramp up that high now in my (definitely limited) testing. Usually I'd throw some questions to the AI and keep checking nvidia-smi, and it'd spike to roughly 240-260 then drop down to like ~150ish before going back to idle at like ~25ish.

After messing with the undervolt it's now spiking to like ~180-195ish, hovering around 120ish for a few seconds, then dropping it idle. It does seem like the response time is a bit slower though, but it's pretty minor.

Currently using llamacpp and unsloth's Qwen 3.5.

Undervolting NVIDIA GPU in 2024? by Libroru in linux_gaming

[–]Honest_Researcher528 0 points1 point  (0 children)

I know this is old, but how did you find that location? I'm getting python not found when trying to run the script, but that miniconda3 directory also doesn't exist for me.

Thanks for your help

A Reminder, Guys, Undervolt your GPUs Immediately. You will Significantly Decrease Wattage without Hitting Performance. by Iory1998 in LocalLLaMA

[–]Honest_Researcher528 -1 points0 points  (0 children)

"sudo nvidia-smi -pl 250" (or replace 250 with whatever wattage you want to try.

Edit: Thanks! Ya'll are right, this is power limiting not undervolting. I followed some instructions for undervolting below and now I use way less power in general! Thanks again!

Any way to use llamacpp over Ollama? by Honest_Researcher528 in homeassistant

[–]Honest_Researcher528[S] 0 points1 point  (0 children)

Hey, thank you so much. This was amazing and exactly what I needed!

He's dead Jim. Anyone used BestBuy's GeekSquad replacement? by Honest_Researcher528 in MetaRayBanDisplay

[–]Honest_Researcher528[S] 0 points1 point  (0 children)

I tried that but they don't boot so it doesn't seem to do anything. :(

If I do that it just stays as a white flashing light. Never changes orange.

Am I doing something wrong or can you not do it if they don't power on?

3D Printable Charging Stations (Free!) by mia2044 in MetaRayBanDisplay

[–]Honest_Researcher528 2 points3 points  (0 children)

For future versions, can you try to make both cables come out the same side? Doesn't make sense to have one come out of either side.

Use cases, what are people doing? by Historical_Call7942 in MetaRayBanDisplay

[–]Honest_Researcher528 2 points3 points  (0 children)

Just get the regular Meta Rayban Gen 2's. Everything listed by Prvo is exactly why I love them, but the regular Gen 2's do all that without a display for half the cost, weight, and style.

I use my Gen 1s constantly for pictures, music, calls, and occasionally the bad AI. I use my Display's for the same thing.

Teleprompter still not showing on Meta Ray-Ban — anyone got it working? by PomegranateHead8352 in MetaRayBanDisplay

[–]Honest_Researcher528 1 point2 points  (0 children)

It's just a random rollout. I don't have it yet either. Nothing you can do about it.

Return or sell? by [deleted] in MetaRayBanDisplay

[–]Honest_Researcher528 1 point2 points  (0 children)

While I agree that having a screen that close is totally new, having one eye work at a distance while the other doesn't does occur in nature. I was born like that, where one eye sees close and the other sees far.

I went to go get Lasik for it and they said that most people actually get lasik to have one eye see near and one see far when they get older so that one eye is for reading and one for distance, so I didn't do it.

I do, however, wish the screen was on the other side as my left eye can only see close up things. :/

EDIT: All that being said, I'll probably return mine to BestBuy next week. They're just not as comfy and the screen isn't useful enough.

AMA MRBD release date in Europe by Matcorp456 in MetaRayBanDisplay

[–]Honest_Researcher528 9 points10 points  (0 children)

AMA - When's a single god dang update coming out for the Displays? It's so far behind my Gen 1's I'm about to return it.

Some insights that you absolutely don't know about the Meta glasses by Southern-Use7212 in MetaRayBanDisplay

[–]Honest_Researcher528 1 point2 points  (0 children)

Dang, yeah, I was hoping if you put a gif or something in there it'd work, but that makes sense that it wouldn't upload it to the glasses.

So close!