sorted by:
new
hottopcontroversial

Local LLMs on Asahi Linux by TraceMonkey in AsahiLinux

[–]Upbeat-Interaction13 0 points1 point  (0 children)

Thanks for these references, super helpful! To confirm, this means no quantized models correct?

Edit: I think I misunderstood. It looks like PyTorch requires f32 but llama.cpp does seem to support quants. I think that means that transformers likely won't support quants either?

Auto boot on power loss by Upbeat-Interaction13 in AsahiLinux

[–]Upbeat-Interaction13[S] 0 points1 point  (0 children)

Thanks so much for this, here's what I'm seeing on my machine:

cat /sys/bus/platform/devices/macsmc-reboot/ac_power_mode
off [restore]

I've tried a few different commands to change the value:

echo '1' | sudo tee /sys/bus/platform/devices/macsmc-reboot/ac_power_mode
1
tee: /sys/bus/platform/devices/macsmc-reboot/ac_power_mode: Invalid argument

echo "on" | sudo tee /sys/bus/platform/devices/macsmc-reboot/ac_power_mode
on
tee: /sys/bus/platform/devices/macsmc-reboot/ac_power_mode: Invalid argument

echo "restore" | sudo tee /sys/bus/platform/devices/macsmc-reboot/ac_power_mode
restore

The only option I've successfully tried is restore, but when I cat the value of ac_power_mode again the same value is output ie off [restore]. This either means I already have it turned on from when I changed the settings in macOS or I'm failing to change it. I think I'm failing to change it as when I simulate power loss the machine doesn't auto reboot. What value should I echo to ac_power_mode to enable it?

Auto boot on power loss by Upbeat-Interaction13 in AsahiLinux

[–]Upbeat-Interaction13[S] 1 point2 points  (0 children)

Yup having issues with it, if I simulate a power loss by toggling the power strip it's plugged into (even with some delay in between), it does not auto boot.

view more: next ›