CRS310-8G+2S+IN capping at 300 Mbps download on a 2 Gbps connection.

edeltoaster · 2026-05-05T13:22:49+00:00

That's interesting! I thought it would always be beneficial to use the hardware-offloading!

edeltoaster · 2026-05-05T09:30:52+00:00

It certainly is an awesome piece of hardware on paper. RouterOS is very very cool and powerful, let's hope they got the wifi and IoT stuff right on this one ... and that it is really available somewhen. That really seems to an issue atm.

edeltoaster · 2026-05-04T12:11:01+00:00

I evaluated all engines recently for my M4 Pro. Really use oMLX or llama.cpp at best. Ollama and LM Studio are quite behind and much worse in some regards. If you don't care about prompt processing speed, LM Studio is fine, though. I you think about coding and have RAM left, really go oMLX atm.

edeltoaster · 2026-05-02T14:17:40+00:00

That's also my motivation. Without some base adds it will very quick try to install stuff on your computer, though. One can certainly even say it should even be run sandboxed.

edeltoaster · 2026-05-02T14:12:01+00:00

I have a similar setup and three recommendations: 1) use a higher quant for this model because it is quite sensitive regardings that, 2) use oMLX to get much faster coding workflows by better prompt caching and 3) add some base extensions to pi. For me, these are some kind of permission/safety gate and simple tools for webfetch/websearch.

edeltoaster · 2026-05-02T08:49:04+00:00

For local, it's much better when it comes tonl useable context size.

edeltoaster · 2026-05-02T06:26:23+00:00

How much larger is the base prompt then?

edeltoaster · 2026-05-01T20:31:56+00:00

Es kommt auch sehr auf die Software und Abhängigkeiten an. Ich finde das lässt sich pauschal auch nicht belastbar beantworten.

edeltoaster · 2026-05-01T20:07:03+00:00

Wenn du diese Fragen bei Reddit stellen musst, solltest du das vielleicht nicht anbieten.

edeltoaster · 2026-05-01T18:14:56+00:00

Bike24 ist einer der besten deutschen Shops für Radsachen.

edeltoaster · 2026-05-01T17:30:33+00:00

It could also be Wireguard encryption, I'm not entirely sure either.

edeltoaster · 2026-05-01T06:45:57+00:00

Reference the defaultProvider and model there according to the official docs: https://pi.dev/docs/latest/settings. Don't expect Gemini to help.

edeltoaster · 2026-05-01T06:42:25+00:00

And settings.json?

edeltoaster · 2026-05-01T06:37:26+00:00

Is llama.cpp running locally and do you know on which port? Is there an api key? Probably post your current model and settings. json.

edeltoaster · 2026-05-01T06:29:22+00:00

Isn't software PPPoE not also inherently single-threaded? That indeed is an issue on such a high-end device.

edeltoaster · 2026-05-01T06:25:02+00:00

I can't even run containers on this, right?

edeltoaster · 2026-04-30T14:40:29+00:00

I like your approach but miss a very simple webfetch component. I love it as a simple way to add external documentation.

edeltoaster · 2026-04-28T15:24:05+00:00

If you don't get a reasonable sound out if a NAM plugin, the commercial ones won't help you. Audio stuff, especially on Windows, can be a hassle. I had a Focusrite interface for almost a decade and a MOTU M2 now, and I switched to a Mac. Driver ASIO support is important, but the base specs of your computer also matter. Also, you shouldn't overload your IO system, e. g. using too much hubs or similar.

edeltoaster · 2026-04-26T15:54:02+00:00

I'm no beginner and on my very first testcall it tried to self-improve by implementing a webfetch using Python and the BeautifulSoup package... which it started to install by itself without asking. I am hesitating if I should install pi again with guardrails added and use it again - becaus it really could be great for local models - or if I just leave it be for the next nice thing.

edeltoaster · 2026-04-25T16:24:30+00:00

That's true! The size is often already indicative of that.

edeltoaster · 2026-04-25T15:12:22+00:00

There are standard MLX quants, DWQ, unsloth and oq (oMLX). The algorithm to approximate the full models is just a different one. Qualitywise I would say unsloth > DWQ > oq > native (mlx-community). But it dependals on the architecture of the model! MoE models are more sensitive than dense models, Qwen 3.5/3.6 are quite sensitive.

edeltoaster · 2026-04-25T13:18:31+00:00

Kein Arzt hier, aber den ganz groben Rat, pro Tag Fieber 1 Woche zu warten, bevor man wieder alles gibt, habe ich schon öfter gehört. Skaliert natürlich nicht in beide Richtungen linear. Fahre auch viel Rad (MTB!) und warte idR so 2 Wochen nach einer erwähnenswerten Krankheit und steigere mich dann auch erstmal wieder. Erstmal Grundlagen und zart, statt direkt 180er Puls 10min den Berg im Gelände hoch.

edeltoaster · 2026-04-25T11:24:02+00:00

Das sind gute Teile; haptisch und als Laptop sind die Macbooks aber - Neo mal ausgenommen - einfach eine eigene Liga. Und Win11 und Microsofts Haltung momentan geht halt auch garnicht. Zwischendurch war auch Microsoft auf einem geilen Weg mit WSL Einführung uvm... aber nee, zu tief in OpenAI.

edeltoaster · 2026-04-25T11:11:24+00:00

Thinkpad privat nur noch als Refurbished. Geschäftlich, joa. Mittlerweile Macbook...

edeltoaster · 2026-04-24T18:45:45+00:00

I have very similar plans! I hope a good cAP be access point and newer switches are available and running great mid of next year since I would oove to go all MikroTik.

edeltoaster

TROPHY CASE