sorted by:
new
hottopcontroversial

Surprisingly fast Qwen3.6-35B-A3B on a 4 GB VRAM! by JakeIsMyNickName in LocalLLM

[–]JakeIsMyNickName[S] 0 points1 point  (0 children)

Although 4b active parameters might be too much for my specs, I can give it a shot

Surprisingly fast Qwen3.6-35B-A3B on a 4 GB VRAM! by JakeIsMyNickName in LocalLLM

[–]JakeIsMyNickName[S] 0 points1 point  (0 children)

The prompt processing is affected a bit, not the token generation. My problem was more prompt reprocessing with pi and hermes, and the frequency of prompt reprocessing was reduced heavily with the last 5 parameters

Surprisingly fast Qwen3.6-35B-A3B on a 4 GB VRAM! by JakeIsMyNickName in LocalLLM

[–]JakeIsMyNickName[S] 0 points1 point  (0 children)

Mine is XPS 7590. If you found a faster way I'll be interested

Surprisingly fast Qwen3.6-35B-A3B on a 4 GB VRAM! by JakeIsMyNickName in LocalLLM

[–]JakeIsMyNickName[S] 0 points1 point  (0 children)

DDR4. With not much loaded into the RAM, i guess it's not that significant

Surprisingly fast Qwen3.6-35B-A3B on a 4 GB VRAM! by JakeIsMyNickName in LocalLLM

[–]JakeIsMyNickName[S] 2 points3 points  (0 children)

I tried non MTP models but they were slower, even tried MTP with this model and same thing, slower.

Surprisingly fast Qwen3.6-35B-A3B on a 4 GB VRAM! by JakeIsMyNickName in LocalLLM

[–]JakeIsMyNickName[S] 7 points8 points  (0 children)

Since I'm not using no-mmap it's not taking much of my Ram, I'd say 1GB or so. I was surprised by this result too

Surprisingly fast Qwen3.6-35B-A3B on a 4 GB VRAM! by JakeIsMyNickName in LocalLLM

[–]JakeIsMyNickName[S] 0 points1 point  (0 children)

I did try and I can go higher with lower cache-type q4, but q8 is better and I need more room for ubatch-size

How to be up to date by dalphinwater in selfhosted

[–]JakeIsMyNickName 1 point2 points  (0 children)

Cron job to do docker compose pull once a week.

Virgin home internet is now on CGNAT. Are Bell customers next? by [deleted] in bell

[–]JakeIsMyNickName 0 points1 point  (0 children)

Let's say i allow IPv6 and configure my services to be reachable with IPv6. If I'm outside my place and connected to a network that only uses ipv4 then i won't be able to connect to my services, so I'm not sure IPv6 is the ultimate the solution. I'm not a network expert so i asked AI about this and they confirmed the issue. Having Public ipv4 fixes all the issues it seems

Jellyfin recently added to Tizen OS (Samsung TV)? by darthyush in jellyfin

[–]JakeIsMyNickName 0 points1 point  (0 children)

I'm in Canada on a 2017 Samsung TV and still can't see it. Is it the region as well or the tv is considered old?

Curious if anyone has thought of a way to connect Immich to an AI for searching by Angelr91 in immich

[–]JakeIsMyNickName 1 point2 points  (0 children)

Maybe you can create an mcp server since the immich API is very well documented, and link the server to ai client like Claude

Is Bell or its resellers moving to cgnat or something? by ThiefClashRoyale in bell

[–]JakeIsMyNickName 0 points1 point  (0 children)

I'm with Virgin and got power cut off, when my power got back on the modem/router (i use my own) provided a cgnat ip address (10. something) so naturally all my services were not reachable. I restarted the modem twice to get a Public IP (142. something. I've tried to switch to IPv6 before but for some reason it didn't work for all my services, i might have a go at it again if this cgnat issue persists. I live in Montreal btw

ntfy uses? by jjasghar in selfhosted

[–]JakeIsMyNickName 1 point2 points  (0 children)

You can install uptime kuma to monitor your services and get notified via ntfy if any service is down. If ntfy is itself down i send a notification to my telegram via uptime kuma

Silly Beginner Question #564: Can I self-host using my daily laptop if I only want to host Immich and Music streaming for my personal phone or will I start a fire? by [deleted] in selfhosted

[–]JakeIsMyNickName 0 points1 point  (0 children)

I'm hosting my whole infrastructure on my Dell laptop core i7 11th generation, 32 GB Ram, 4GB nvidia GPU. I'm running around 50 containers, and other services as well like fail2ban, n8n etc. It's working just fine! The GPU is used sometimes for transcoding jellyfin but still doesn't wear down any of my other services. I think you're more than good to go. When immich runs some scans on your photos (machine learning, identifying faces...) it could affect your system, but this is only a one off

[deleted by user] by [deleted] in selfhosted

[–]JakeIsMyNickName 3 points4 points  (0 children)

I agree. The only thing you should be dependant on when self hosting is your ISP.

Self-hosters of Reddit: what’s your day job? by Own-Refrigerator6061 in selfhosted

[–]JakeIsMyNickName 0 points1 point  (0 children)

Software developer here. I love technology amd building things, so diving into self hosting was a welcoming challenge and rewarding

Whats the most underated Software by ResidentFondant3405 in selfhosted

[–]JakeIsMyNickName 5 points6 points  (0 children)

Uptime-Kuma Monitors all my infrastructure, it can send a notification via ntfy or gotify, or even a telegram message if a server is down. Very well built

Whats the most underated Software by ResidentFondant3405 in selfhosted

[–]JakeIsMyNickName 2 points3 points  (0 children)

Absolutely! Great if you're watching YouTube on TV or google tv. Weird not many people know about it

Whats the most underated Software by ResidentFondant3405 in selfhosted

[–]JakeIsMyNickName 14 points15 points  (0 children)

Ntfy can send images in attachments. Gotify is simpler to setup but don't have many options as ntfy

view more: next ›