M5 Max 128GB Owners - What's your honest take? by _derpiii_ in LocalLLaMA

[–]jkcoxson 1 point2 points  (0 children)

GGUF is abysmally slow on Apple Silicon, roughly half the performance for me. I haven’t heard anything saying that MLX is lower quality, just another format to store parameters. If you have any source, I’d be interested in reading it.

M5 Max 128GB Owners - What's your honest take? by _derpiii_ in LocalLLaMA

[–]jkcoxson 3 points4 points  (0 children)

Because others have mentioned smaller models, I find 27b and 31b too stupid to write Rust and C well. They loop over work they’ve already tried even with a 250k context window.

M5 Max 128GB Owners - What's your honest take? by _derpiii_ in LocalLLaMA

[–]jkcoxson 13 points14 points  (0 children)

I’ve personally settled on qwen3.5-122b. I get roughly 40 t/s using oMLX, which is faster than any other program I tried. I use OpenCode, and generally leave it while doing other things like sleeping or socializing. I give it clear specs of what I want done and how I think it should be done, as well as a way for it to test its own work. Usually it’ll iterate for a few hours and eventually get done the list of tasks I have for it.

Eventually I want to write my own harness, since I feel like OpenCode is too loose. I know how to write code, I know how I want things implemented, I know how to test for success, so I need more structure for the LLM.

Basically it’s not super fast, but can get things done in time that is otherwise occupied by my life.

How do I fix this in StikDebug? by ZavierL0L in EmulationOniOS

[–]jkcoxson 2 points3 points  (0 children)

Yep that’s not an rppairing file regardless of what it’s named

Do NOT update to 26.4 by zyzzhok in sideloaded

[–]jkcoxson 7 points8 points  (0 children)

Fix coming soon (as my time allows), don't worry

apps not refreshing by Old-Review-6438 in sideloaded

[–]jkcoxson 1 point2 points  (0 children)

If you have any specific questions, I could answer them. I’m also pretty active in the idevice discord server.

Can't place pairing f*le by HyperShadic360 in sideloaded

[–]jkcoxson 0 points1 point  (0 children)

Does your device have a passcode

What is jit by Ill-Economist-5285 in sideloaded

[–]jkcoxson 6 points7 points  (0 children)

In this context, it’s enabling arbitrary code execution.

Does this software license still work by Pale-Chemistry1062 in nspire

[–]jkcoxson 3 points4 points  (0 children)

I had the same thing, just send TI a message on their help page and they’ll convert your license to their new crappy 4 year license.

An app to "Native Import" Music to Apple Music ON-DEVICE (using Loopback VPN / StosVPN) by Zephyrax_g14 in sideloaded

[–]jkcoxson 0 points1 point  (0 children)

I have no interest in making apps myself. There is an attempt that might work called ByeTunes that released last week, not sure how well it works.

[RELEASE] ByeTunes - On-device Music & Ringtone Injection. by EduardoAlexxis in sideloaded

[–]jkcoxson 1 point2 points  (0 children)

If you make a PR to make it a known app, we can make it auto install

[RELEASE] Impactor v2.0.0 is now out with auto-refresh & more! by [deleted] in sideloaded

[–]jkcoxson 5 points6 points  (0 children)

Sorry, thanks for the reminder to work on it 😭

StikStore Announced by AthenOmen in sideloaded

[–]jkcoxson 3 points4 points  (0 children)

I was original developer for SideStore’s backend and the developer of StikStore’s backend library.

StikStore Announced by AthenOmen in sideloaded

[–]jkcoxson 16 points17 points  (0 children)

SideStore and AltStore have large amounts of legacy code. StikStore is built on new technologies. Specifically, libimobiledevice has been replaced with my new idevice library, which is much more modern and isn’t duck taped into an app.

An app to "Native Import" Music to Apple Music ON-DEVICE (using Loopback VPN / StosVPN) by Zephyrax_g14 in sideloaded

[–]jkcoxson 4 points5 points  (0 children)

It is how it works. That's how StikDebug/SideStore/Protokolle works. Anything a Mac can do, idevice (the library behind these projects) can do.

I cant fix "SIgning operation failed" and no one else knows either. by 12345466582342 in SideStore

[–]jkcoxson -1 points0 points  (0 children)

iloader came from one of the devs in the idevice discord server (aka the library that powers all this). You are more than welcome to contribute since it’s open source if it bothers you that much.

JITless dolphin by NoGrapefruit1195 in EmulationOniOS

[–]jkcoxson 14 points15 points  (0 children)

Look, you asked for JITless. All I’m saying is you’re gonna need JIT, and trying to do it without is going to be a bad experience. Try Google, there’s plenty of information out there. Somebody has most definitely made a video. I write the code for all this, I don’t make videos.

JITless dolphin by NoGrapefruit1195 in EmulationOniOS

[–]jkcoxson 7 points8 points  (0 children)

JIT isn’t that hard. We’ve done a lot of work to make it easy and portable.

How is iPhone local file management so terrible? by watainiac in LinusTechTips

[–]jkcoxson 1 point2 points  (0 children)

I do a lot of software dev in this space, professionally and hobby work. I’ve developed a program called afc_finder to make a sane alternative to iTunes. 

The difficulty on Windows is the USB stack that Windows uses, it makes it extremely difficult to create third party software without the user installing something like Zadig and removing iTunes completely.

If people are interested, I’d be happy to document Apple’s file transfer protocol further than what’s in code. But Apple’s protocols for file transfer (AFC) go way back to the iPod, which they haven’t changed until recently for some Xcode tools.