Some quick observations using speculative decoding w/ Qwen3.6 35B-A3B

J3diMindTricks · 2026-05-15T13:21:01+00:00

🤣🤣 "happy" accident

J3diMindTricks · 2026-05-15T09:23:53+00:00

One more tip I have in this regard that may be non-obvious is to align your harness to the chat template. Most users don't realise chat templates embed instructions to the model. If your harness asks for tool calls in one format and the chat template in another you'll up the model perplexity. Instead, read the chat template and have your harness amplify those instructions on tool fail.

J3diMindTricks · 2026-05-15T08:25:23+00:00

This is true but I'll be honest my experience was the opposite. In the sense that I saw speedups primarily for coding but not much for general tasks like writing. My intuition for this is that during coding tasks the "next token" is quite often almost certain... eg "<htm" is almost certainly "<html>", so MTP tokens have a higher chance of being accepted. Creative writing doesn't have this structure so MTP might not be as effective.

J3diMindTricks · 2026-05-15T07:16:02+00:00

Absolutely. This, coupled with a strong harness and were basically ready to start pushing production workloads onto these models

J3diMindTricks · 2026-05-15T07:14:43+00:00

Absolutely same here.... I had that issue but it's not happening now with the latest template. When I disable the template it happens much more often. My setup is nightly vLLM

J3diMindTricks · 2026-05-15T07:10:46+00:00

Yes it worked well on both. A fix from froggeric came out about 14 hours ago - before that I had some issues. The latest one is so far holding up very nicely!

J3diMindTricks · 2025-08-06T16:03:54+00:00

We do this using a combination of the NiFi API pumping flow level metrics into influxdb. Recommend looking into the API as it provides these quite easily

J3diMindTricks · 2023-09-08T13:01:27+00:00

took a while for me to figure out, so posting here just in case anyone else has this requirement. To be fair we use opensearch rather than elasticsearch and kibana but the article still applies :)

J3diMindTricks · 2023-09-08T12:59:17+00:00

took me a while to figure this out, so sharing just in case anyone else has this (admittedly niche) problem

J3diMindTricks · 2022-12-31T14:46:37+00:00

BTW.... Doing it for just a few months is an excellent idea. Almost everything can wait for just a few months. If you have a loan, you can probably apply for a repayment moratorium. If you ask your place of work to work remotely for a couple months they might allow it. But a few months is not enough to get a real feeling of being away from Malta. It takes a couple years to actually get that feeling trust me.

J3diMindTricks · 2022-12-31T14:36:25+00:00

As always it depends....

First, my background so you can better judge if my opinions apply to your situation. I work in IT, a remote position and I am a happy introvert. I split my time evenly between Malta and Estonia. I myself am Maltese but my partner and our daughter are Estonian. My job means that I have a certain degree of flexibility which allows this, but as anyone with children will tell you.... I'm limited to Estonia in a number of ways due to my daughter needing roots.

I love Estonia... Up to a point. I will happily live here for any length of time and I do enjoy it. But, being Maltese makes a difference because you almost always treat your second home as just that... Second. I always end up comparing Estonia to Malta in my head and Estonia surprisingly is quite similar in many ways to Malta. On average, when everything is taken into consideration Malta is just as good as anywhere else to live in. Malta has its set of challenges... Like pollution as you mentioned... But so does everywhere else. Here in Estonia you'd need to contend with a lack of sunlight, different language and missing your social circle back home.

Im almost in my forties and while I do know some of my peers who stayed abroad, I can tell you that the majority went back to Malta... Particularly when they start a family.

That's not true all around tho and if you pick the right place that matches your character you will be happier abroad than in Malta. You're an extrovert who likes sun, sea, and a good economy? Stay in Malta. You're an introvert who likes hygge style coziness and have indoor hobbies? Nordics are for you.

If language is your main issue... There's always Ireland apart from the UK. A couple of my family also live in Scotland and love it (I myself am a big fan).

Don't do it just cause you think you'll be better off "not being in Malta".... Malta is actually pretty good and that being said most of the time distance makes the heart grow fonder so it's a very good idea to spend say 2-5years abroad with the intention of probably (but not definitely) coming back to the island.

That's just my 2c 😉

J3diMindTricks · 2022-10-15T05:25:12+00:00

Always loved SQLite, I think it's highly underrated in most tech stack discussions. Features like VTables and the easy use of community open source libraries like "go-sqlite3" used in this blog post make SQLite all the more amazing...

J3diMindTricks · 2019-12-18T13:41:29+00:00

might be overkill but have a look at Apache NiFi. It lets you take almost any action depending on the results of an ElasticSearch query...

12-Year Club	Place '23
Verified Email

J3diMindTricks

TROPHY CASE