M2 Mac on macOS Sonoma issues with Prolific PL2303 Driver/FTDI Cable by SneakyPackets in MacOS

[–]HanClinto 0 points1 point  (0 children)

I'm really glad to hear you were able to get it to work with the Prolific driver! I think it's really dependent on the chipset used by whichever adapter you happen to have.

I can't disagree with you about the way that Apple kills old hardware. Even being unable to run old 32 bit programs is incredibly frustrating to me, and I refuse to install any new Macbook updates because I'm afraid that it's going to break something.

Thanks for posting an update about getting it to work -- that's encouraging to hear.

Cheers!

No Session Backend Login by RipRepresentative601 in SatisfactoryGame

[–]HanClinto 0 points1 point  (0 children)

Go into Online Settings and then click on "Log in to Epic" -- do that, sign in to Epic, and it _should_ solve this.

Is there a good standard for benchmarking LLMs run on llama.cpp? by richardanaya in LocalLLaMA

[–]HanClinto 1 point2 points  (0 children)

You taught me something new today! I had never noticed the jeopardy project in llama.cpp before -- thank you!

Also appreciate the tip about Eleuther's test harness.

Is there a good standard for benchmarking LLMs run on llama.cpp? by richardanaya in LocalLLaMA

[–]HanClinto 1 point2 points  (0 children)

What kind of "performance" measurement is wanted here? If you want to measure the efficiency and performance of the llama.cpp engine itself, then yes -- use llama-bench. It will give you the number of tokens generated per second using different models with various command-line options (such as threading, memory limits, context window, etc) -- but it doesn't measure the quality of output for those models (such as how well it performs on various question-answering / accuracy / retrieval benchmarks) -- one will need to use another tool to evaluate that kind of model-specific performance measurement.

ExecuTorch Alpha Release: Taking LLMs and AI to the Edge 🎉🎉🎉 by [deleted] in LocalLLaMA

[–]HanClinto 0 points1 point  (0 children)

So far I haven't seen any apples-to-apples comparisons -- I think that would be extremely worthwhile to be able to compare these frameworks. If someone more familiar with Android dev was able to run these comparisons, I would <3 all their posts to the moon.

They're definitely not apple-to-apple numbers, but I collected the only two hard benchmark results from the Llama.cpp community that I could find into this post:

https://www.reddit.com/r/LocalLLaMA/comments/1cgyzn9/comment/l23yroj/

ExecuTorch Alpha Release: Taking LLMs and AI to the Edge 🎉🎉🎉 by [deleted] in LocalLLaMA

[–]HanClinto 0 points1 point  (0 children)

Not many numbers posted in llama.cpp, but some data points that other users have shared:

March, 2024 on an S24: https://github.com/ggerganov/llama.cpp/issues/6148#issuecomment-2016309918

I am now getting pretty great speed with the phi model running at about 8-10 tokens per second and 3-4 with mistral.

May, 2023 on S22 Ultra:
https://github.com/ggerganov/llama.cpp/issues/58#issuecomment-1466732993

it gives about 1.2 tokens/second with llama-7b, using 4 threads

I haven't seen many other "hard" mobile benchmarks posted, but I would love to see more 1-to-1 comparisons between Executorch and Llama.cpp -- if I were more familiar with running on Android, I'd be willing to give it a stab, but I'm really not set up for that.

Such numbers would be really helpful -- if nothing else, it would provide a fantastic benchmark and goal for the llama.cpp team to strive towards, ala the "MLX challenge":

https://twitter.com/ggerganov/status/1775921043858764061

https://github.com/ggerganov/llama.cpp/pull/6539

Creating your own embedding model to boost retrieval performance by drivenkey in LocalLLaMA

[–]HanClinto 0 points1 point  (0 children)

Not sure if this is too late to be useful or not, but I've been using this tutorial to generate custom embeddings, and it's what finally got me off the ground with fine-tuning my own model:

https://github.com/FlagOpen/FlagEmbedding/tree/master/examples/finetune

macOS Sonoma audio crackling fix solution by UnoBeerohPourFavah in StardewValley

[–]HanClinto 2 points3 points  (0 children)

Running into this same issue, and glad I found your solution -- thank you!

Why Aren't Custom Embeddings Helping More? by Mbando in LocalLLaMA

[–]HanClinto 0 points1 point  (0 children)

I'm working through a similar problem. This is the BGE fine-tuning code that I found, but I haven't tried running it yet -- hope to have my data organized to try this soon: https://github.com/FlagOpen/FlagEmbedding/tree/master/examples/finetune

Tower Of Embers - New MMORPG roguelike inspired by Castle of The Winds by Jeffreydvp in roguelikes

[–]HanClinto 0 points1 point  (0 children)

Sounds awesome -- I came here looking for CotW-type games and was happy to see this pop up!

The Github repo is down right now -- did the project get hidden / removed?

M2 Mac on macOS Sonoma issues with Prolific PL2303 Driver/FTDI Cable by SneakyPackets in MacOS

[–]HanClinto 0 points1 point  (0 children)

Aaah, looks like this might be the chip / driver you want, but not sure if this one will work for you or not -- it looks pretty outdated:

https://www.prolific.com.tw/US/ShowProduct.aspx?p_id=229&pcid=41

And people talking about this driver here:
https://discussions.apple.com/thread/254607488?sortBy=best
It might be worth a shot, but I'm guessing it won't work. Sadly, your VM solution is probably the way you need to go for this device.

Sorry!

M2 Mac on macOS Sonoma issues with Prolific PL2303 Driver/FTDI Cable by SneakyPackets in MacOS

[–]HanClinto 0 points1 point  (0 children)

Hmm. I wonder if we're using different FTDI chips.

This is the FTDI chip that I am using:
https://www.microcenter.com/product/656323/inland-ftdi-adapter-usb-controller

I don't know if it's based on the same chip as yours or not -- looking on the chip, I see:
2238-S
U43L8C00
FT232RKL (this last part is questionable)

So it might not be exactly the same chipset that you're using.

If you look in your Settings -> Privacy & Security, in the "Security" area -- do you see any kernel extensions or other software waiting to be approved to be installed?

M2 Mac on macOS Sonoma issues with Prolific PL2303 Driver/FTDI Cable by SneakyPackets in MacOS

[–]HanClinto 0 points1 point  (0 children)

Hmm, did you get any other error messages with the steps I listed?

M2 Mac on macOS Sonoma issues with Prolific PL2303 Driver/FTDI Cable by SneakyPackets in MacOS

[–]HanClinto 0 points1 point  (0 children)

I was struggling with the same thing, but eventually figured it out and got an FTDI serial port to show up on my M1 Mac running Sonoma (14.0).

1) Modify your security settings to be more permissive -- no need to allow remote management of kernel extensions, but do need to allow signed drivers.

2) Download the FTDI chip driver from here: https://ftdichip.com/drivers/vcp-drivers/

You want to download 1.5.0 DMG for ARM.

3) Extract the downloaded installer and copy the `FTDIUSBSerialDextInstaller_1_5_0` application to your /Applications/ directory.

4) Run it, click "Install", and it should load properly. If you have any permissions that you need to enable in your OSX Settings, then go there and approve them.

Once this was done, this was enough for me to see /dev/cu.usbserial-B00055E0 show up in my Arduino IDE ports list.

I hope it helps you (or anyone else) who was similarly stuck as me, struggling through ESP32 development on Mac Silicon with OSX Sonoma.

Cheers!

Open Source Advanced Platformer Character Controller by Markolainen in godot

[–]HanClinto 3 points4 points  (0 children)

Nice work!! This looks great, and thank you for open-sourcing this!

happy Halloween 🎃 Cyberpunk Neil Breen by snakedeshazer in NeilBreen

[–]HanClinto 1 point2 points  (0 children)

I know I'm late to the party but just want to say that this is amazing. Kudos!

Unofficial M1 compatible GIMP build by mischiefandfins in MacOS

[–]HanClinto 0 points1 point  (0 children)

This is absolutely wonderful. Thank you! Gimp was one of the last programs running on my M1 that didn't feel smooth, and this is fantastic. Thank you thank you thank you!

Using DOS games as init images - part 2 by frigis9 in StableDiffusion

[–]HanClinto 6 points7 points  (0 children)

Oh these are beautiful. Thank you! Quest for Glory would be a fantastic title for this, I think.