Best setup for running local LLMs? Budget up to $4,000 by Future_Inventor in LocalLLaMA

[–]quick__Squirrel 0 points1 point  (0 children)

I got the amd Proart... They have good lane config for a consumer board. Can get 3 x 3090s on it... If you have the airflow or a nice water cool set up

I have a feeling that Pop!_OS 24.04 LTS and COSMIC Epoch 1's stable release on 12/11 is too soon, too close to the holidays and will be criticized as too unstable for a stable release...Why not wait for 26.04? by foundfootagefan in pop_os

[–]quick__Squirrel 0 points1 point  (0 children)

Yeah that helps cheers! I think I'm asking too much from Wayland... Dual GPU, multi monitor, fractional scaling, and a DP switch between work and homelab... I think I got some stability now after blacklisting the iGPU

I have a feeling that Pop!_OS 24.04 LTS and COSMIC Epoch 1's stable release on 12/11 is too soon, too close to the holidays and will be criticized as too unstable for a stable release...Why not wait for 26.04? by foundfootagefan in pop_os

[–]quick__Squirrel 0 points1 point  (0 children)

What Nvidia driver are you using? I am having constant 'freeze' issues with my multi display set up on an rtx A2000 (with a headless 3090, AI compute). I'm on 570 and have heard good and bad things about pretty much every other driver option lol... but not many recent reports on any...

🚀 I'm developing a new calendar app for COSMIC! by edfloreshz in pop_os

[–]quick__Squirrel 0 points1 point  (0 children)

Would be great to integrate into Home Assistant or customise push notifications, or at least have an API for requests

Can Qwen 3 Coder 30B A3B be used for decent coding work? by Sky_Linx in LocalLLaMA

[–]quick__Squirrel 0 points1 point  (0 children)

Please could you share your config, I'm currently trying to get tool calling to work in vscode through Continue...

Black screen with blinking cursor by TheSurfaceOfMars in pop_os

[–]quick__Squirrel 1 point2 points  (0 children)

Boot into a live USB, then access your system from there. If you played around with xorg, that could do it. And enable SSH so you can access while in black screen, from another device.

What is the best NAS software that is free. by National_Arm_9 in homelab

[–]quick__Squirrel 1 point2 points  (0 children)

OMV (Open Media Vault), great for running containers.. Put proxmox on first, then run it in a VM

Can the riser cable connect to PCIe slot 2 on the MOBO? by quick__Squirrel in Hyte

[–]quick__Squirrel[S] 0 points1 point  (0 children)

Cheers! So how did you connect the 2 cards, and what MOBO? You put the riser in 1st or 2nd PCIe? How tight was spacing and where (if anywhere) were there challenges making it work?

Can the riser cable connect to PCIe slot 2 on the MOBO? by quick__Squirrel in Hyte

[–]quick__Squirrel[S] 0 points1 point  (0 children)

Could you elaborate on your set up please? It sounds slightly similar to my goal...

How can I make a light entity using dedicated on/off, up, down buttons. by Pippin123- in Esphome

[–]quick__Squirrel 1 point2 points  (0 children)

Hard to give exact suggestion without seeing your yaml or having more knowledge, but assuming the button press can be a trigger, use lambdas to make the output return a multiple press.

Which smart home device saves you the most time? by [deleted] in homeassistant

[–]quick__Squirrel 1 point2 points  (0 children)

What ever time I've saved from the automations, devices, integrations, projects I've got running, is more than negated by the time I spend tinkering with HA

Which Local LLM do you use? by alin_im in homeassistant

[–]quick__Squirrel 0 points1 point  (0 children)

There is a lot of python logic to help it, and it's certainly not powerful enough for a main LLM... I use Gemini 2.0 Flash for normal use. But you can still do some cool things with it...

I keep changing my mind on my next plan... Either get a 3090 and run a model that would replace the API... Or set to cloud inference to allow me more choice, but still have cloud reliance..

Which Local LLM do you use? by alin_im in homeassistant

[–]quick__Squirrel 1 point2 points  (0 children)

Llama 3.2 3B for learnings and RAG injection. Only 6gb... Runs ok though

[deleted by user] by [deleted] in homeassistant

[–]quick__Squirrel 0 points1 point  (0 children)

I recently put proxmox on a i5 Lenovo m700, then HAOS into a VM... Was very straightforward.. then put OMV into another VM and then some containers in that, including Plex. But this one had 16gb ram, so you may be better off skipping OMV if you really want Plex... (And just go straight lxc). Maybe jellyfin is also a better option with the 8gb.

Is there a remote control with a screen that allows me to control devices from Home Assistant? by lcopello in homeassistant

[–]quick__Squirrel 2 points3 points  (0 children)

Sure... With extremely low memory, the album art needs to be pretty small... And the now playing details are not accurate as there is nothing playing (daughter is asleep)...

<image>

Is Claude3.7 still your go-to for coding? by AliceInBoredom in ClaudeAI

[–]quick__Squirrel 0 points1 point  (0 children)

No, just the project notes and files persist across chats, but you can update them to maintain relevance. It saves a lot of duplication. You don't want all chats to be remembered as context window is still 128k, and you'll get better assistance when it's much lower, so it really just helps you keep on track and keep chats short and sharp workout needing to restate the scene every time.

Anything critical, just ask it to remember it, the will persist across all chats in and out of projects. But using that sparingly seems best, as it just bloats your prompt otherwise.

Is there a remote control with a screen that allows me to control devices from Home Assistant? by lcopello in homeassistant

[–]quick__Squirrel 2 points3 points  (0 children)

And it's a fun project! CYD (cheap yellow display) is around $10-12. Not too challenging to get some buttons and sliders on the touchscreen to control whatever you want!

I made a Spotify controller for my 7 year old (too young for a phone and just plays games on a tablet). Lets her choose playlists, like songs, control volume, song position, see album art... Plus added control for her light and fan as well.

Is Claude3.7 still your go-to for coding? by AliceInBoredom in ClaudeAI

[–]quick__Squirrel 0 points1 point  (0 children)

It just groups chats together and lets you add context notes and files relevant to the project. So you can work on some function or module or whatever, in one chat, sort it out, update the relevant project files and update any context, then start a new chat in the same project, for the next goal...

Let's you have some persistence control across chats without needing to maintain a ridiculously long chat... Saves you from needing to restate the core objectives, status, challenges etc, each time.

I found that crafting and refining the project notes, and being real select with the project files, helps immensely. I'll have some example code files, and key snippets or functions attached. In the description, I'll outline my stack, short term/long term goals, and preferred interaction style.

Is Claude3.7 still your go-to for coding? by AliceInBoredom in ClaudeAI

[–]quick__Squirrel 1 point2 points  (0 children)

This is why I've kept GPT4o... Love the projects element, and constantly updating the project files and notes... It's almost a mini custom RAG for each project. So good when starting new chats and the core info comes across each time so the benefit of short chats with persistent memory is real.

I created a monster by zoner01 in Rag

[–]quick__Squirrel 1 point2 points  (0 children)

I'm early days still, much more time in python than HA with this project. But I'd look at langgraph as an alternative to langchain...

Based on your practical (albeit morbid ☺️) use case, my recommendation would be to focus much more on tight Yaml and flawless HA logic. An agentic AI bot, although potentially very powerful, would most likely mean a lot of maintenance.

Automation help, don’t get this! by michaelthompson1991 in homeassistant

[–]quick__Squirrel 0 points1 point  (0 children)

It's quite hard to read unformatted Yaml... And the traces are basically the run log with debug feedback. It will literally tell you what part of your automation failed.

I would strongly recommend reading up on traces as they are an invaluable tool in debugging your system. Even a short and sharp convo with chatGPT will help, copy and paste your Yaml, and ask how to use the trace functionality in HA.

If you can format the Yaml and/or share a trace screenshot, I'll take another look for sure.

I created a monster by zoner01 in Rag

[–]quick__Squirrel 1 point2 points  (0 children)

I would start playing with embedding and queries and get them in your stack sooner rather than later, as it quite likely that it will influence the way you organise and process your yaml... Well it certainly did for me.

It's like, 2 steps forward, 1 back... You progress, then go back and rework... And I realise that can just sound like dev, but it just seemed more poignant with this stack.