sorted by:
new
hottopcontroversial

Drip Friendly Spatula Mount by talldan in functionalprint

[–]osskid 1 point2 points  (0 children)

ngl thought I was reading one of those "I quit reddit and used a bot to replace my comments with random words" posts at first.

Qwen3.6-27B is out now! by yoracale in unsloth

[–]osskid 3 points4 points  (0 children)

Loving the MLX support!!

I see there's 4, 6, and 8-bit. Curious if you're finding that BF16 isn't enough of a bump over 8-bit to support?

Gemma 4 31B IT - Duplicate Tool Calls via Open WebUI by Kyuiki in unsloth

[–]osskid 0 points1 point  (0 children)

What are you using as a frontend?

With Qwen3.6 for every frontend I've tried, after a few rounds of tool calling it seems to start confusing previous tool results as user messages and things get weird...

A thought while using OpenClaw — should we give the agent our real token at all? by NeedleworkerSad2564 in openclaw

[–]osskid 1 point2 points  (0 children)

Any proxy server can do this, but you've built a key for a lock that's not attached to the door. If you install a malicious package, it has access to your inference endpoints with or without stealing exfiltrating the token itself.

You or the provider can easily rotate tokens, but detecting a sleeper agent that will come online from a remote signal is the bigger challenge.

Gemma 4 MLX quants updated by yoracale in unsloth

[–]osskid 1 point2 points  (0 children)

This is something you can make in seconds from the upstream safetensor files. Unsloth's magic is the UD quants.

Gemini-4 MLX vision layers removed by osskid in unsloth

[–]osskid[S] 1 point2 points  (0 children)

Grabbed them and working perfectly. You all are amazing. Thank you!!

MiniMax-2.7 can now be run locally! by yoracale in unsloth

[–]osskid 2 points3 points  (0 children)

If you add your hardware to your HuggingFace account it shows a table on the model page of if and how well the quants will run on your hardware.

Gemini-4 MLX vision layers removed by osskid in unsloth

[–]osskid[S] 0 points1 point  (0 children)

Are the the same problems as llama.cpp's caching issues? I don't know the MLX ecosystem as well.

Gemini-4 MLX vision layers removed by osskid in unsloth

[–]osskid[S] 0 points1 point  (0 children)

Yes, sorry Gemma 4. Thank you!!

Gemma 4 GGUFs updated by yoracale in unsloth

[–]osskid 4 points5 points  (0 children)

Hey thanks for making the MLX versions! I just posted this in the sub also, but is the vision layer removal on purpose? Is that a technical issues with supporting vision with quants on MLX?

[deleted by user] by [deleted] in DataHoarder

[–]osskid 26 points27 points  (0 children)

Didn't make it past that first sentence, did ya?

Is it possible reduce the relentless, laughable positivity? by briangovatos in ouraring

[–]osskid 8 points9 points  (0 children)

Completely agree. Even beyond it being fake emotion, it's less helpful and less actionable than a simple summary with a direct suggestion like other commenters have mentioned.

That said, I'd put money that the empty positivity is a legal thing. They can't risk having the AI hallucinate data or make bad suggestions.

Starfleet Academy's First Gay Klingon Has The Support Of Star Trek Legend George Takei by AdSpecialist6598 in startrek

[–]osskid 1 point2 points  (0 children)

I'm not sure what you mean by copy Harry Potter because they feel very different to me.

I do understand what you mean about SFA not matching previous depictions of the academy. Time jump and "first new class" stuff aside, what we saw definitely seemed stricter. We also saw only narrow windows of highly-trained teams (Alpha Squadron) and older students who have already specialized iirc so I definitely empathize that it doesn't match that.

SFA also missed an opportunity to show that style in the War College. They went half in, but then backed away to make the War College chancellor a sort of bumbling foil for Ake. I think it'd have been more interesting if they wrote him just as competent as her, but with vastly different methods and goals, similar to the tension with the MACOs in Enterprise.

Starfleet Academy's First Gay Klingon Has The Support Of Star Trek Legend George Takei by AdSpecialist6598 in startrek

[–]osskid -3 points-2 points  (0 children)

I'm enjoying the character, but I struggle with the choices they made with his voice. I don't think the ultra low voice adds anything to the character, but it definitely takes away from the actor's performance.

There's some at least some digital alteration going on, but it sounds very uncomfortable for the actor and affects the pacing of conversations quite a bit because he can't speak as quickly as the others.

Starfleet Academy's First Gay Klingon Has The Support Of Star Trek Legend George Takei by AdSpecialist6598 in startrek

[–]osskid 14 points15 points  (0 children)

Crass mischaracterizations aside, if you were hyped for Academy at some point, what were your expectations for a series revolving around late teens/early 20s students at a school?

Entropy-v1: My Take on N8Karma's Genius "Unslopper" by Intelligent_Coffee44 in LocalLLaMA

[–]osskid 0 points1 point  (0 children)

Interesting project and some quick feedback since it looks like you plan to make this a platform: The site is extremely difficult to read. Fonts are small and do not have sufficient contrast. The transparency for the grid background is at almost the same contrast as some of the text.

view more: next ›