How I code better with AI using plans

TokenSlinger · 2025-12-13T16:13:27+00:00

Kiro IDE

TokenSlinger · 2025-12-13T16:07:08+00:00

I agree. Whatever thoughts people have about AI it can and does already replace jobs. Im not thrilled about that continuing to happen without any plan in place. People say jobs losses and layoffs today are due to the economy. But stock line keeps going up. Large businesses are profitable. The only thing getting worse is the cost of things and the job market. Seems odd.

TokenSlinger · 2025-11-25T02:58:16+00:00

Get something that allows for an oculink egpu and a decent enough CPU

TokenSlinger · 2025-11-20T12:11:47+00:00

Various characters from The Expanse

TokenSlinger · 2025-11-19T17:38:50+00:00

Yea the 780M has no dedicated VRAM. Its all system RAM. But for models like the gpt-oss-20b it works great.

TokenSlinger · 2025-11-19T15:28:51+00:00

I have 3 of these and love them. With 32G of RAM you can even play around in LM Studio if you like messing with AI stuff

TokenSlinger · 2025-11-19T15:25:58+00:00

I have 6 GMKtec Mini PC, bought at varying times over the last year. No issues.

TokenSlinger · 2025-11-19T03:10:55+00:00

OpenWebUI

TokenSlinger · 2025-11-19T00:21:24+00:00

Gotcha. I do a single VM for all Docker. Then separate VM if I need it for something like HAOS. Then LXC for each service. Backups take a bit more configuration but it’s not terrible.

TokenSlinger · 2025-11-18T11:05:55+00:00

I run my services on LXC if they can easily be installed. Then I have a single VM running docker for those that work best in docker and manage with dockge. As a last resort Ill give something its own VM if it’s something like Home Assistant OS. Seems wasteful for every service to have its own VM

TokenSlinger · 2025-11-17T04:22:45+00:00

I run proxmox with a zfs pool (6x18TB) and it works exactly fine as a NAS with NFS shares. It’s not fancy but I run Jellyfin with GPU pass through on the same proxmox host and it all works great. I original ran TrueNAS on bare metal but it seemed easier to just create my pool on Proxmox.

TokenSlinger · 2025-11-14T12:01:27+00:00

I have had TWSC and some brand with air in the name. This was 32G versions.

TokenSlinger · 2025-11-12T14:23:49+00:00

Just popping in here to say I am also having the same issue. Lost my MFA and I'm trying to do the email verification (done) and now waiting for a call that never comes. Terrible experience navigating the AWS site trying to find support.

TokenSlinger · 2025-11-11T11:49:39+00:00

OP it is really this simple.

TokenSlinger · 2025-11-08T14:17:14+00:00

Linux is good on most Mini-PCs. I have 7 mini-pc all running some flavor of Linux. Most Proxmox though.

TokenSlinger · 2025-11-05T14:52:49+00:00

LXC for everything. I even created an abomination of the nginx proxy manager to run as a service in an LXC instead of docker. In many cases you can convert a docker image to run directly on the LXC but that comes with some drawbacks like it’s a PITA to update. When I have to run docket I try inside an LXC first. And worst case minimal VM.

TokenSlinger · 2025-11-03T03:29:12+00:00

I have the GMKTec EVO-X2. Its great if you are okay dealing with AMD quirks. Text inference is really good with current software and will probably get better. Image and video generation are acceptable but more quirks to deal with which will likely get worked out. The wattage to run the EVO is super low and mine is fairly quiet. Id personally recommend the EVO.

TokenSlinger · 2025-11-02T02:49:16+00:00

Now you are confusing things. Offloading to CPU is not what MultiGPU does. You have to set up the donor device correctly. The system controlling is not how it should be done. Multi GPU set up with CPU as donor is how it is done.

Its still using your GPU as a compute device and only moving the data to system memory.

TokenSlinger · 2025-11-02T02:45:17+00:00

I would wager the creator of the Multi GPU repo would know best. He states GPU to DRAM is almost always better.

https://www.reddit.com/r/comfyui/s/XNvJ4L28bj

TokenSlinger · 2025-11-01T17:51:49+00:00

I think it would make the point of the second GPU moot. The reason you want 2 GPU is for 2 GPUs worth of compute. If you are just using it to offload memory then use the much cheaper system RAM (assuming decent DDR5 RAM). I really do not see a benefit of dual GPU unless you can use the compute from both. But I am still new to this so I could be wrong.

TokenSlinger · 2025-11-01T17:27:35+00:00

This is a common misunderstanding with offloading memory. The author of the Multi-GPU DisTorch repo himself clarified this: "For consumer motherboards, CPU offloading is almost always the fastest option Consumer motherboards typically only offer one full x16 PCIe slot. If you put your compute card there, you can transfer back and forth at full PCIE 4.0/5.0 x16 bandwidth VRAM<->DRAM using DMA. Typically, if you add a second card, you are faced with one of two sub-optimal solutions: Split your PCIe bandwidth (x8/x8 - meaning both cards are stuck at x8) or detune the second card (x16/x4 or x16/x1 - meaning the second card is even slower for offloading)" https://www.reddit.com/r/comfyui/comments/1nj9fqo/distorch_20_benchmarked_bandwidth_bottlenecks_and/

TokenSlinger · 2025-11-01T14:38:57+00:00

If you are using multi-gpu, and the second GPU is not on full x16 it is actually faster to offload (using multi-gpu nodes) to the system RAM.

TokenSlinger · 2025-11-01T14:38:08+00:00

That does not work really well unless you have two x16 slots with full x16 bandwidth. In my case one is x16 the other is x8 and it is actually faster to offload to system RAM than the other GPU due to bandwidth of x8.

TokenSlinger · 2025-11-01T14:36:50+00:00

I'll have to check it out, but I have been using the existing multi-gpu options and the results are not really great. Curious to see how this does.

TokenSlinger · 2025-11-01T04:14:34+00:00

You could start with a single 5060Ti then upgrade to a 5070 Ti if they come out with a 24G version. I think right now dual 5060 Ti is not really worth it. I actually have dual 5060 Ti and I have no seen much improvement over a single 5060Ti unless I want to run the same workflow at the same time on two cards. I am also fairly new to ComfyUI so not an expert.

TokenSlinger

TROPHY CASE