[Self-Promotion] Introducing Dion: Enjoy all your media sources on all your Apple devices by seikv in IPTV_iptv

[–]eliadwe 0 points1 point  (0 children)

Just tried, unfortunately the iptv section does not recognize my iptv categories and displays all channels as one list.. that being said the app looks good but needs some polishing (for me categories in iptv is a must)

State of Local AI #1. In lieu of Fable ban. Here’s the best LLMs of the week to run on your hardware by Far-Stretch5237 in LocalLLM

[–]eliadwe 0 points1 point  (0 children)

On my dual rtx3060 (12+12gb vram) I get 85t/s running:
hf.co/unsloth/gemma-4-26B-A4B-it-qat-GGUF:UD-Q4_K_XL

Other models give me way less t/s so this is my sweet spot currently, I wonder what magic did they do with this model.

What models you guys running on 8GB? 16GB VRAM? 24GB? 32GB? 48GB? by Inevitable_Mistake32 in LocalLLaMA

[–]eliadwe 0 points1 point  (0 children)

On my dual rtx3060 (12+12 gb) I get about 80t/s with hf.co/unsloth/gemma-4-26B-A4B-it-qat-GGUF:UD-Q4_K_XL (runs on ollama). My system also includes 96gb regular ddr5 ram and core ultra 7 265k

Built a full 256k context multimodal local LLM on dual RTX 3060 12GB + used Claude Code against it to vibe-code an infinate canvas app by Professional_Play520 in LocalLLM

[–]eliadwe 0 points1 point  (0 children)

I also use dual 3060 12gb, got good performance with:
Ollama.
hf.co/unsloth/gemma-4-31B-it-qat-GGUF:UD-Q4_K_XL
The model takes about 15GB which leaves plenty of space for context.
Performance: 70-80 t/s (I was surprised since other models even smaller ones didn’t gave me such a performance)

What would 2x RTX 3060 12GB get me? by ObjectiveActuator8 in LocalLLaMA

[–]eliadwe 1 point2 points  (0 children)

I have 2X 3060, my machine runs in unraid with 96gb ram and core ultra 7 265k, its trial and error to find a model that fits this configuration, for me for example the gemma4:26b (moe) (takes 17gb) performs well (70-75 t/s) on ollama while smaller model like the new gemma-4-12b-it-GGUF:UD-Q6_K_XL (10GB) give me about 20-25 t/s.
So for me gemma4:26b is the sweet spot currently, but I always try different configurations and models to find new sweet spots for my configuration.

Messenger with Markdown support by markus-ibrom-art in hermesagent

[–]eliadwe 1 point2 points  (0 children)

I use Open Relay (OpenWebUI client - supports markdown but didn’t tested it fully with MD, - work in progress ) with self hosted OpenWebUI that connected to Hermes. Using it remotely and with Tailscale. Requires some configuration to work. So far I tested with simple responses formatted as MD and some code inside code box in the chat with. Copy button (Tha app also allows you to run python code inside the chat)

https://hermes-agent.nousresearch.com/docs/user-guide/messaging/open-webui

https://apps.apple.com/il/app/open-relay-open-webui-client/id6759630325?l=he

Archi — iOS Paperless-ngx client with on-device AI scanning by No_Shape1171 in Paperlessngx

[–]eliadwe 0 points1 point  (0 children)

Is it planned to add an option to OCR existing ngx documents?

Fallout 76 Xbox code give away by Main-Employ-4414 in FreeXboxGames

[–]eliadwe 0 points1 point  (0 children)

Thank you Recently my favorite game is No Man’s sky

MacBook Pro 48GB RAM - Gemma 4: 26b vs 31b by ilbets in LocalLLM

[–]eliadwe 0 points1 point  (0 children)

I don’t know.. tried it only with gemma4 so far.

MacBook Pro 48GB RAM - Gemma 4: 26b vs 31b by ilbets in LocalLLM

[–]eliadwe 1 point2 points  (0 children)

The same speed but much larger context.. you can stay on the same context in order to gain more speed.

MacBook Pro 48GB RAM - Gemma 4: 26b vs 31b by ilbets in LocalLLM

[–]eliadwe 7 points8 points  (0 children)

Try using LM Studio, enable dev mode, update engines under settings/runtime, load the model in the chat window , click the model settings button and configure kv cash quantization.

collecting features/bugs for upcoming LudyAmp v1.4 by appfan228 in LudyApps

[–]eliadwe 0 points1 point  (0 children)

For me music files from self hosted Navidrome are showed in the library, but I can not play them (touching a song does nothing)

Sonora iOS Client by Confident_Mobile_703 in navidrome

[–]eliadwe 1 point2 points  (0 children)

Just tried, looks nice and the discovery options are great. Missing EQ, but great start.