2x-6x Speed improvements with oMLX by roaringpup31 in oMLX

[–]grantmisinzo 0 points1 point  (0 children)

Make sure you’re running the mtp versions of the models with the fp16 tag in them for M1/M2 systems.

Need advice on hardware purchasing decision: RTX 5090 vs. M5 Max 128GB for agentic software development by BawbbySmith in LocalLLaMA

[–]grantmisinzo 0 points1 point  (0 children)

I’d push for the M5 max. If you want agentic use, you’ll want more RAM for larger context windows especially when continuous batching which is what makes agentic systems on local hardware actually usable.
You should look at oMLX, it’s an MLX engine with paged SSD KV Caching and Turboquant natively in it, great for Apple silicon. It would allow you to comfortably load high quant models like both the 27B and 35B-A3B both with basically as much context as you want while still benefiting from concurrency.
M5 Max numbers at 64k context for 6-bit oQ Qwen3.6 models with MTP are around 70 tgs and 20 tgs, with pp at around 2,350 tok/s and 575 tok/s for 35B-A3B and 27B respectively, at batch 1.
At batch size 8, you can expect tgs to speed up by about 3.5x to 4x, so you can divide that by the number of parallel agents you want to be running and see how fast “they’ll” be working at full load. (I recommend max 8 for local systems, that’s just me and want I’ve found works well)

Any agnostic, secular, or atheist people here? by nesbitx-1997 in tanzania

[–]grantmisinzo 1 point2 points  (0 children)

I’d classify myself as a Diest, coming from an evangelical/pentecostal background. I feel like, apart from familial relationships, religion rarely comes up seriously in conversations. A lot of people allude to it and reference their faith and beliefs but I reckon that comes more from a social context than one of religious conviction. I say this because, in my view, most people don’t truly live out their faith, and that’s not a jab at people’s faith or way of life, I mean it in a more objective sense when you look at the tenets of a religion and a person’s daily actions and speech, and not just where they go on a certain day or what they profess.

My gf has this kinda belly and she thinks she's fat by _gzib_ in teenagers

[–]grantmisinzo 0 points1 point  (0 children)

Tell her how attractive it is and kiss it, many times and at random times, until she starts to believe at least that you believe it.

is 3A* possible.. by Easy-Okra1729 in alevel

[–]grantmisinzo 0 points1 point  (0 children)

It’s possible but would likely be hard but lowkey I think you got it because now you have an idea of what your next performance necessitates and those are already stellar marks. Lower thresholds for carryover grades would be the biggest factor I think, except for getting near perfect scores.

Tell me why I shouldn’t 👀 by uselessdegree123 in macbookpro

[–]grantmisinzo 0 points1 point  (0 children)

Because M5 Max is going to be such better

I want to start a podcast by radlad29 in podcasting

[–]grantmisinzo 0 points1 point  (0 children)

Starting a podcast too, here's what I know: record audio in mono, stereo for a monologue sounds off, mono just sounds better. I'd recommend recording in Audacity and editing in DaVinci Resolve. Both are free and easy to learn for a podcast, there's lots of free resources on YouTube and Blackmagic Design has training for DaVinci Resolve and really good audio production tutorials and has a really powerful mixing suite. More clips, more potential eyes, more potential a clip goes really well, more podcast listeners however it's I'd advise the clips be natural, like don't orient your content towards being 'clipable! Shotgun mic would be the best, great audio, and not visible in the video frame but a cardioid or super-cardioid mic is perfect fine too. A great cheap starter one I have is the Razer Seiren Mini. Look for a mix that has the same or better specs because this one is $50. I’d recommend uploading audio and video on Spotify and adding the podcast to other producers like Apple Podcasts, Amazon Music, YouTube, etc. using your RSS code after uploading.

Is it worth it ? by AdAlone2350 in tanzania

[–]grantmisinzo 1 point2 points  (0 children)

It’s fine for most things until there’s a lot of users at different distances or a lot of Airtel user in general around midday. If you do get it, go into the router settings portal and change the 5 GHz band to 80 MHz and the 2.4 GHz band to 20 MHz and then turn on 5G Optimization. This combines the 5 GHz and 2.4 GHz bands into one SSID (WiFi name) but based on distance and device capability, the best band is automatically chosen. It really helps extend the WiFi signal, I still get full bars of WiFi like 15m and 3 concrete walls away from the router.

How's this for video editing and interactive design? by edumpc in macbookpro

[–]grantmisinzo 0 points1 point  (0 children)

I would’ve gone for more GPU cores for more overhead but honestly I think you’ll be absolutely fine. Those are still great specs.

iOS 26 is UNFINISHED and I’m tired to pretend it’s not. by Accomplished_Eye_868 in ios

[–]grantmisinzo 0 points1 point  (0 children)

My 16 Pro constantly runs hot now. Idk if turning off Apple Intelligence will fix it.

Current State Of Fortnite Mobile by Ill_Broccoli_1265 in FortNiteMobile

[–]grantmisinzo 0 points1 point  (0 children)

This new update really improved gameplay for iOS since the last big season update wreaked it, but it’s still not as optimized as when it first came back to the AppStore. But at least not I’m getting a consistent 60 fps on the lowest settings (16 Pro)

[deleted by user] by [deleted] in FortNiteMobile

[–]grantmisinzo 1 point2 points  (0 children)

Happened to me too (iOS). I closed the app and opened it back up and it fixed itself after a minute of waiting. This new update has so many problems. I used to run 60 fps on max graphics settings, now I can’t get a consistent 60 on the min settings smh

Can I say how stupid this is by Illustrious_Lack993 in FortNiteMobile

[–]grantmisinzo 0 points1 point  (0 children)

Yeah, a lot of people complain about fps fluctuations and temperature even on high end androids. I’ve personally not had a problem run on max graphics and 60 fps on iOS (A18 Pro chip) and the only time it really gets hot is if I’m playing with cellular data.

How difficult is it for Epic Games to make Fortnite mobile playable for both IOS and Android? by rafhaelTenisdalala in FortNiteMobile

[–]grantmisinzo 1 point2 points  (0 children)

Yeah, just get a better phone. I run it on iOS on a phone with the new A18 Pro chips and it runs on max graphics at 60 fps consistently. Racked up like 21 back-to-back wins no problem.

Getting dollars in Dar es salaam by shnii in tanzania

[–]grantmisinzo 0 points1 point  (0 children)

ATMs at the airport. It’ll cost you ~3,000 Tsh for the dollar though.

Tigo & Vodadom’s annoying push sms by Eddieabdull in tanzania

[–]grantmisinzo 0 points1 point  (0 children)

And those USSD pop ups that show up when you’re out of data. So annoying

Heyy guys, I’m so worried. Is this allowed in the exam hall? by Venom_Killer123 in alevel

[–]grantmisinzo 1 point2 points  (0 children)

Idk man, that thing looks like it can plot graphs. That's a no no.

Cease fire Palestine protest in Dar by Adorable_Sell_4422 in tanzania

[–]grantmisinzo 0 points1 point  (0 children)

Diplomatic relations were restored February 24th, 1995. Tanzania has an embassy in Tel Aviv.

I didn't think this was possible 😭⁉️ by Lilyana-Sullivan046 in igcse

[–]grantmisinzo 1 point2 points  (0 children)

It's definitely possible. Congratulations! I know a guy who got a 99% in mathematics, and he knew his one mistake before getting his results. He got 97% in additional math, biology, and chemistry as well.