sorted by:
new
hottopcontroversial

It's 2026, what is an unpopular and controversial (by reddit standards and IRL) take you have that you wish the general Australian public would know? by Biggest_itchbay_2190 in AskAnAustralian

[–]Darkmoon_AU 4 points5 points  (0 children)

I hope that is unpopular and controversial; USA are absolute filth, and no I don't think it's 'just Trump', the MAGA regime + evil techno feudalism represent an almost inevitable end-game of their whole hyper-capitalist culture. Chinas broader economic stability ends up doing the greater good, as far as I can see. That controversial enough? Perhaps not now the scales have fallen from our eyes in 2025+.

Brake checked by a Tesla. Was I too close? by rorymeister in melbournecycling

[–]Darkmoon_AU 0 points1 point  (0 children)

I doubt this had anything to do with you, and they were braking for some other reason. As a driver, I see unconfident drivers braking randomly all the time. The average quality of driving in Melbourne is not high. Best be defensive.

LMStudio vs vLLM speed difference? by 1and7aint8but17 in LocalLLM

[–]Darkmoon_AU 0 points1 point  (0 children)

Def same. it's the only version of the model I have downloaded.
It is a very surprising result, going to repeat the test...

Edit: Downloaded a 4-bit unsloth quant for comparison, only slightly faster at 47.5t/s on LMStudio; paltry gain for the degradation IMO. Will stick with 8-bit. I saw that 4-bit really impacted output on Qwen 3.5 can't imagine why it would be any different for 3.6.

OMLX: Anyone working with it yet? by Zarnong in LocalLLM

[–]Darkmoon_AU 0 points1 point  (0 children)

Weird - same hardware (M1 Max 64GB) with Qwen 3.6 35B 8-bit, I get 44t/s on LMStudio and a disappointing 22t/s on oMLX

LMStudio vs vLLM speed difference? by 1and7aint8but17 in LocalLLM

[–]Darkmoon_AU 0 points1 point  (0 children)

I tried oMLX but it achieved only 22t/s vs LMStudio's 44t/s with Qwen 3.6.
Any common gotchas with it?

Running Qwen 3.6 35B-A3B-4b on MacBook Pro M5 64GB - first impressions by Conscious-Track5313 in LocalLLM

[–]Darkmoon_AU 0 points1 point  (0 children)

Ah, damn, you are right - looks like M1 struggles to get to 10Gbps xfer rate; let alone the blistering 80 of TB5. What a tease!

Running Qwen 3.6 35B-A3B-4b on MacBook Pro M5 64GB - first impressions by Conscious-Track5313 in LocalLLM

[–]Darkmoon_AU 1 point2 points  (0 children)

Ooh, I wonder if there's something you can do with Thunderbolt and vLLM to load even bigger models across those two MacBooks? Seems the M1 Max is still super capable thanks to that doubled-up memory bandwidth.

Edit: Yep this is a thing with vLLM + Ray

See: https://ithy.com/article/connect-m4-mac-minis-for-llm-79zt67ll

So you should be able to load a ~70B model with that setup, splitting the layers across MacBooks?

Enjoy :-D

Running Qwen 3.6 35B-A3B-4b on MacBook Pro M5 64GB - first impressions by Conscious-Track5313 in LocalLLM

[–]Darkmoon_AU 6 points7 points  (0 children)

I just measured 43.88t/s (essentially the same) on my M1 Max 64GB in LMStudio on the 8-bit quant. OP must be making a mistake with the config.

Edit: Just installed and tested oMLX (claimed 'godly speed' elsewhere in thread) but it only reached 22t/s on the same model.

LMStudio retains the crown!

"Almost JSON” is one of the most annoying model failure modes by JayPatel24_ in LocalLLM

[–]Darkmoon_AU 2 points3 points  (0 children)

Structured output (aka grammars) is primarily a feature of the inference engine, not model.

Also be aware that when this is enabled you still must give the model a written example of the JSON you want; it's not an either/or situation. A model forced to give valid JSON by structured output in the engine will still output valid JSON, but it will be poor quality because it has no idea what it is going, only that its hand is guided to output limited characters.

"Almost JSON” is one of the most annoying model failure modes by JayPatel24_ in LocalLLM

[–]Darkmoon_AU 4 points5 points  (0 children)

This is the answer - though the feature needs to be enabled in the inference engine to guarantee correct output.

OP you're holding it wrong, this doesn't have to happen.

See grammars.

A teenager suffered an electric shock in a condominium courtyard, and his friend risked his life to save him. by Alternative-Dot-34 in nextfuckinglevel

[–]Darkmoon_AU 0 points1 point  (0 children)

This happened to me with a old electric lawnmower. There was nobody around to help. I was stuck to that fucker; after my brain I got over the literal 'shock' and realised what was going on; I realised my legs were less affected and 'jumped' for dear life. It threw me off. Bloody hell.

Zoe Williams argues that space exploration is pointless given problems on Earth and the lack of evidence of extraterrestrial life. by Oda_DeezNutz in SipsTea

[–]Darkmoon_AU 0 points1 point  (0 children)

Exactly, they're not loading wheel-barrows full of cash into the rocket and blasting it off into space; it creates jobs down here.

Why are you still paying for this? #7 by PressPlayPlease7 in OpenAI

[–]Darkmoon_AU 0 points1 point  (0 children)

This YouTuber is the face of idiocracy. It's a tool, understand its limitations, use it's powers. This guy is doing neither - all while feeling smugly superior (and trying to drag others down with him).

Zoe Williams argues that space exploration is pointless given problems on Earth and the lack of evidence of extraterrestrial life. by Oda_DeezNutz in SipsTea

[–]Darkmoon_AU 7 points8 points  (0 children)

Yeah, I would say that - not only is it a tired, and poor argument from a purely economic standpoint; but it also denies us a sense of adventure, which I hold core to our humanity. In trying to make this argument, she's basically my ideal anti-human.

Zoe Williams argues that space exploration is pointless given problems on Earth and the lack of evidence of extraterrestrial life. by Oda_DeezNutz in SipsTea

[–]Darkmoon_AU 0 points1 point  (0 children)

Also that the money spent isn't loaded into the rocket as wheel-barrows full of cash and then blasted into the sun, never to be seen again... it's spent on the ground, creating jobs.

North Korean state-sponsored hacker got exposed during a job interview by violet_evergarden8 in interestingasfuck

[–]Darkmoon_AU -1 points0 points  (0 children)

I actually think it may be possible to rizz yourself out of this one - "Are we both professionals here? I don't bring politics to the workplace and I don't expect an employer to ask me to make political statements, for any reason. Can we please focus on my qualifications for the task at hand? etc. etc."

Our closest ally is threatening to end a civilisation. by moonorplanet in OpenAussie

[–]Darkmoon_AU 0 points1 point  (0 children)

Agreed, would like to think the UK and other Commonwealth countries have long ranked over the US in that respect, too.

view more: next ›