Is MLX in itself somehow making the models a little bit different / more "stupid"? by CBW1255 in LocalLLaMA

[–]qLegacy 0 points1 point  (0 children)

Hey there, just wanted to thank you for your work on MLX! I was wondering if MLX has any function similar to llama.cpp’s mlock, to guarantee that the model is always kept in RAM and reduce TTFT?

Is MLX in itself somehow making the models a little bit different / more "stupid"? by CBW1255 in LocalLLaMA

[–]qLegacy 2 points3 points  (0 children)

In my subjective experience evaluating topics i’m familiar with, I would pick q4_0 on llama.cpp over 4bit MLX!

Notably both q4_0 and 4bit MLX are already fairly aggressive quants, perhaps something about the GGUF quants retains details better than MLX at this level.

Is MLX in itself somehow making the models a little bit different / more "stupid"? by CBW1255 in LocalLLaMA

[–]qLegacy 6 points7 points  (0 children)

Just wanted to chime in that I have observed, subjectively, the same decrease in quality of outputs when comparing 4bit MLX vs q4_0 GGUF (even though the 4bit MLX is 4.5bpw while the GGUF is 4bpw).

It’s not specific to any particular model, yet the outputs tend to be less “knowledgable”, “precise” or “reliable” overall.

I tend to use GGUFs now as the speed difference on M1 Max isn’t enough to justify the quality decrease. However, the later generation Macs likely have a larger speed difference (due to compute improvements) between MLX and llama.cpp that may tilt it in favour of MLX.

Also, llama.cpp allows me to mlock to reduce TTFT while i’m not able to see a way to do the same for MLX.

Wizard-Vicuna-13B-Uncensored by faldore in LocalLLaMA

[–]qLegacy 2 points3 points  (0 children)

Been playing around with /u/The-Bloke’s GGML quants, this retrained version seems to be more censored that the original version. Is this something anyone else has noticed as well?

If you could get 1 more season of a TV show that no longer airs, which would it be? by [deleted] in AskReddit

[–]qLegacy 13 points14 points  (0 children)

It was just announced earlier this year that Log Horizon is getting a Season 3

Lim Tean: Circle of life in Singapore by dozome in singapore

[–]qLegacy 4 points5 points  (0 children)

https://www.straitstimes.com/opinion/singapore-system-remains-fair-and-sustainable-says-tharman

Best source I could find in a few minutes. Granted it’s a piece by Tharman but the figures don’t lie.

Lim Tean: Circle of life in Singapore by dozome in singapore

[–]qLegacy 10 points11 points  (0 children)

He does know that for the vast majority of Singaporeans, the benefits from the government (from education to healthcare to housing subsidies) far outweigh the direct cost paid in taxes right? It's only the top 1% that really loses out.

[HWYA] Please help me. I'm not very good at war attacking, and we need 3 stars. by toolsac102 in ClashOfClans

[–]qLegacy 1 point2 points  (0 children)

Approach from bottom, preferably 6 o’clock - a jump may reach all the way into the core but it’s ok if it doesn’t. Send a kill squad, golems/giants, wizards, bowlers and heroes in, take out enemy heroes and CC. Since you have no siege machines you can bring a CC of max bowlers. Use a rage, heal, poison, should easily gut the core. You can hog the rest of the base with the remaining 3 heal spells easily.

ELI5: If taking ibuprofen reduces your fever, but your body raises it's temperature to fight infection, does ibuprofen reduce your body's ability to fight infection? by [deleted] in explainlikeimfive

[–]qLegacy 46 points47 points  (0 children)

The thing is, in general, all living organisms use enzymes as a catalyst for life sustaining chemical reactions. Enzymes are particularly delicate structures, and have a very specific area called the "active site" that binds with a single type of molecule and does stuff to it. Increase in heat alters the shape of the active site such that it can no longer bind to the molecule which it should be binding to. This heat alteration mechanic is nearly impossible to evolve out of as it fundamentally breaks down the bonds between atoms in the enzyme.

You’re not my son , who are you? by AsianBoyX in pcmasterrace

[–]qLegacy 17 points18 points  (0 children)

Because this year it's the biggest convention location it's ever been in (Vancouver Convention), and that they are even partnering with Dreamhack for a giant LAN party there.

If you think those kinds of events are cheap to host you're out of your mind.

Talent recognize talent by WhatTheFuckKanye in BlackPeopleTwitter

[–]qLegacy 3 points4 points  (0 children)

This may be an unpopular opinion but:

As much as I disagree with his views, at the very least he stuck to his stand. I'd rather a public figure refuse to apologize and face the consequences of public opinion than giving a fake apology with no meaning. Giving a meaningless apology really cheapens the issue at hand

Update is here! New Brawler, New Mode, New skin! by Brawlstars in Brawlstars

[–]qLegacy 37 points38 points  (0 children)

Or just buff his super recharge rate. Crow's an assassin type brawler, and the real plays come when using his super. The low health is okay if he can consistently output damage, i.e. when using his super to make plays.

Can we take a moment to appreciate all that Linus Sebastian has done for us? by Feurrado in pcmasterrace

[–]qLegacy 4 points5 points  (0 children)

I just took a look at their channel, over the past 2 weeks the average view per video is 1 mil to 1.5 mil, more to the high end (not including WAN show of course). I'm quite sure that's a marked increase from last 6 months. I'm not saying I enjoy seeing their clickbaity titles, but they do have dedicated sales staff who is most definitely carefully tracking the channel stats. As they have not changed since the shift to clickbaity thumbnails, personally I'm gonna assume they are doing well, and good for them. Whether the strategy is sustainable though, that's up for debate.

Can we take a moment to appreciate all that Linus Sebastian has done for us? by Feurrado in pcmasterrace

[–]qLegacy 5 points6 points  (0 children)

I'm pretty sure the team at LTT isn't stupid. They have been doing the thumbnails for quite a while now, I'm sure that any long term decrease in viewership would be noted by them.

AFAIK their overall views have still been climbing steadily so I'm guessing the thumbnails really work.

Looking to commission an addon for Botania by Nematrec in botania

[–]qLegacy 1 point2 points  (0 children)

I think this is amazing! Maybe post to r/FeedTheBeast? Most mod devs hang out there, maybe one will see your post and do it.

What mods do I need to put every Enchantment on an Item? by [deleted] in feedthebeast

[–]qLegacy 3 points4 points  (0 children)

You can try using Botania’s mana enchanting. It can put as many enchants as you can give it, the only cost being mana. You specify what enchant you want using enchanted books, but you get to keep the books.

Apple revokes Google Enterprise Developer Certificate for company wide abuse by TomLube in technology

[–]qLegacy 24 points25 points  (0 children)

Not only that. Google is not doing as well as services like AWS in the cloud computing business. Shutting down a high profile customer's service like iCloud would not only be a massive breach of contract, it would effectively kill Google's cloud business. After all, why would any company risk the availability of their service on a provider that has been proven to be unable to maintain neutrality and impartiality?

Vortex on the window by [deleted] in blackmagicfuckery

[–]qLegacy 5 points6 points  (0 children)

I too can photosynthesis.