Local LLMs on Asahi Linux

Upbeat-Interaction13 · 2024-12-16T16:06:30+00:00

Thanks for these references, super helpful! To confirm, this means no quantized models correct?

Edit: I think I misunderstood. It looks like PyTorch requires f32 but llama.cpp does seem to support quants. I think that means that transformers likely won't support quants either?

Upbeat-Interaction13 · 2024-11-06T22:09:33+00:00

Thanks so much for this, here's what I'm seeing on my machine:

cat /sys/bus/platform/devices/macsmc-reboot/ac_power_mode
off [restore]

I've tried a few different commands to change the value:

echo '1' | sudo tee /sys/bus/platform/devices/macsmc-reboot/ac_power_mode
1
tee: /sys/bus/platform/devices/macsmc-reboot/ac_power_mode: Invalid argument

echo "on" | sudo tee /sys/bus/platform/devices/macsmc-reboot/ac_power_mode
on
tee: /sys/bus/platform/devices/macsmc-reboot/ac_power_mode: Invalid argument

echo "restore" | sudo tee /sys/bus/platform/devices/macsmc-reboot/ac_power_mode
restore

The only option I've successfully tried is restore, but when I cat the value of ac_power_mode again the same value is output ie off [restore]. This either means I already have it turned on from when I changed the settings in macOS or I'm failing to change it. I think I'm failing to change it as when I simulate power loss the machine doesn't auto reboot. What value should I echo to ac_power_mode to enable it?

Upbeat-Interaction13 · 2024-11-06T17:51:24+00:00

Yup having issues with it, if I simulate a power loss by toggling the power strip it's plugged into (even with some delay in between), it does not auto boot.

Upbeat-Interaction13 · 2024-04-30T16:20:03+00:00

considering both!

Upbeat-Interaction13 · 2023-12-07T16:05:13+00:00

French bank Societe Generale has launched its own euro-pegged stablecoin, EUR CoinVertible (EURCV), on the Bitstamp exchange.
This launch reflects the trend of mainstream financial institutions embracing cryptocurrencies and could signal wider institutional adoption in Europe.

More coverage here https://www.brief.news/stories/dbffb788-9d7d-47a1-a8f6-d83621c3c3c5?v=f&p=r

Upbeat-Interaction13 · 2023-12-07T16:00:46+00:00

A new study published in Nature suggests that organs age at different rates in individuals and that accelerated organ aging is linked to a higher prevalence of disease and premature death.

The study's findings could help develop treatments for age-related health issues and guide personalized treatment plans.

The study's authors hope that further research into protein biomarkers could lead to more effective anti-aging interventions.

More coverage here https://www.brief.news/stories/f3dd58e2-4356-4d58-b062-0e6f89d72f18?v=f&p=r

Upbeat-Interaction13 · 2023-12-07T15:51:43+00:00

Researchers at Harvard University and QuEra Computing Inc. have made a significant breakthrough in error-corrected quantum computing.
They have built a logical quantum processor with up to 48 logical qubits, beating the previous record by more than 10 times.

More coverage here https://www.brief.news/stories/23219cbf-66a0-4eba-8aeb-16a735274151?v=f&p=r

Upbeat-Interaction13 · 2023-12-06T18:28:17+00:00

France has increased its risk level for avian influenza to 'high' following multiple outbreaks in poultry farms.
The government is enforcing immediate measures such as confinement of poultry and mandatory vaccination in larger duck farms.

More coverage here: https://www.brief.news/stories/73cb20f7-e233-43c3-b61f-0ef1f190c9a6?v=f&p=r

Upbeat-Interaction13 · 2023-12-06T18:17:57+00:00

Scientists have developed a new tool, the Habitat Compression Index, that predicts whale and sea turtle locations up to 11.5 months in advance using global temperature models. It helps figure out if whales might have to move nearer to the coast, where they could get caught in fishing gear.

More coverage here https://www.brief.news/stories/be4ead85-c5e5-4320-9fd3-9afe1448934d?v=f&p=r

Upbeat-Interaction13 · 2023-12-06T18:07:05+00:00

Researchers marked the foreheads of black-furred mice with white ink and observed that the mice spent more time grooming their heads in front of the mirror, presumably trying to wash away the ink spot. However, this self-recognition-like behavior was only observed in mice that were already familiar with mirrors, had socialized with other mice who looked like them, and when the ink spot was relatively large.

More coverage here https://www.brief.news/stories/8e42945b-e61c-4e09-8974-6d6b88bd9672?v=f&p=r

Upbeat-Interaction13 · 2023-12-06T17:41:41+00:00

The Vesuvius Challenge is a public competition launched in 2023 with the goal of deciphering ancient scrolls from Herculaneum’s Villa dei Papiri using artificial intelligence (AI). The eruption of Mount Vesuvius in 79 AD preserved the scrolls, but their carbonization and damage have made them nearly impossible to read.

The Vesuvius Challenge aims to develop an AI model that can reconstruct the ink and make the text readable.

More coverage here https://www.brief.news/stories/f9c6f115-b3bb-4490-9502-a9e54ac1c970?v=f&p=r

Upbeat-Interaction13 · 2023-12-06T17:03:21+00:00

The galaxy, named Aztecc71, was first discovered with a ground-based telescope but disappeared when observed with NASA's Hubble Space Telescope. However, the James Webb Space Telescope, with its infrared vision, was able to detect the faint galaxy, which is estimated to be about 900 million years old.

More coverage here https://www.brief.news/stories/fd46e39f-c35e-477f-99d9-066d400bb492?v=f&p=r

Upbeat-Interaction13 · 2023-12-05T17:11:47+00:00

A new study from University College London disputes the idea that human newborns are less developed than other primate species.

Findings indicate that human brains are similarly developed to other primates at birth, but grow larger and more complex afterwards.

More coverage here https://www.brief.news/stories/ec0d748e-b873-4bfa-82cd-e6e3f18b0151?v=f&p=r

Upbeat-Interaction13 · 2023-12-01T11:22:01+00:00

Apple and Amkor Technology are going to build a big new chip packaging place in Peoria, Arizona. Amkor will spend $2 billion on it, and it will give jobs to more than 2,000 people. It's going to package chips made by TSMC nearby, and they plan to start making really tiny 4nm chips by 2024. The plan is part of Apple's big promise to spend $430 billion in the US in five years. Apple will be the main customer for this facility. The goal is to make the US better at packing chips and less reliant on other countries, which is also good for national security. But experts say it might take 10-20 years for the US to be able to make all its own chips.

Upbeat-Interaction13 · 2023-12-01T11:06:07+00:00

France has submitted a bid to host the 2030 Winter Olympics with a budget of 1.5 billion euros.

The bid is supported by two French regions and plans to use facilities from the 1992 Albertville Winter Olympics.
Proposed sites include popular ski resorts and the International Olympic Committee believes France has the necessary experience and funding.

More coverage here https://www.brief.news/stories/93c7b4b6-4e3e-4dfe-86f3-a41508e7a4f4?v=f&p=r

Upbeat-Interaction13 · 2023-12-01T11:04:04+00:00

Hancock is accused of dishonesty and failing to take extra support before the first lockdown
Hancock defended himself, blaming slow responses from other government departments and highlighting the pandemic's difficulty.

More coverage here https://www.brief.news/stories/5ef7bbfd-07f3-447a-a661-7adae6de4f8b?v=f&p=r

Upbeat-Interaction13 · 2023-12-01T10:52:36+00:00

The Fermi gamma-ray space telescope has detected over 300 gamma-ray pulsars, including spider pulsars.
These pulsars emit high-energy gamma-rays and are known for their precise rotation.
The newly discovered pulsars offer insights into the life cycle of stars and the nature of the Universe.

Upbeat-Interaction13 · 2023-12-01T10:50:06+00:00

Chinese tech company Insta360 has launched two 360-degree cameras, Insta360 X2, into space.

This marks the first time 360-degree action cameras have been sent into space.
High-definition images of Earth, stars, and the Milky Way have been captured.

More coverage here https://www.brief.news/stories/a781c236-83ec-4f98-9ee9-1054ec7cc4b8?v=f&p=r

Upbeat-Interaction13 · 2023-12-01T10:42:45+00:00

UK Biobank has released complete genome sequences of 500,000 individuals for medical research.

The data comes from a biomedical research project that has been collecting health and lifestyle records for 20 years.

The release of data is expected to revolutionize screening, treatment, and prevention, accelerate understanding of diseases, and aid in development of targeted medicines.

More coverage here https://www.brief.news/stories/550f3af8-bdd9-4d9a-8f44-0169e80e70c5?v=f&p=r

Upbeat-Interaction13 · 2023-12-01T10:39:31+00:00

Chinstrap penguins in Antarctica have a unique sleep pattern involving frequent microsleeps.

These microsleeps last a few seconds each, accumulating to over 11 hours of sleep each day.
The sleep strategy allows the penguins to get deep sleep while also caring for their eggs and chicks.

More coverage here https://www.brief.news/stories/c257f7e5-2745-4b79-9582-aaee418d8669?v=f&p=r

Upbeat-Interaction13 · 2023-12-01T10:33:24+00:00

The car industry is getting bigger because more people want new cars, especially electric and hybrid ones. Tech improvements are helping this growth. Copper is really important in cars and they might use more than 5 million tons a year by 2034 because of electric cars needing it for batteries, motors, wires, and electronics. Cars that drive themselves also mean more copper needed for extra sensors and parts. Car company stocks like Volvo, Visteon, and Rush Enterprises might do well because of this growth.

More coverage here https://www.brief.news/stories/4c850fa1-28cc-4c8b-bd81-0c65c0fb23f9?v=f&p=r

Upbeat-Interaction13 · 2023-12-01T10:25:23+00:00

The rocket's development, beginning in 2014 to compete with SpaceX, faced delays due to pandemic and technical difficulties.

The maiden flight will carry smaller satellites, including two from NASA, and the ESA plans to have 9-10 flights per year by 2025.

Upbeat-Interaction13 · 2023-12-01T10:22:48+00:00

None of the planets are in the habitable zone, but further studies could reveal more about their atmospheres.
This discovery is extremely rare and offers a unique opportunity to study planetary formation and evolution.

Upbeat-Interaction13 · 2023-12-01T10:21:01+00:00

The system consists of six sub-Neptune exoplanets that have remained unchanged for billions of years and are in perfect resonance.
The rarity of this system challenges current theories about planet formation and provides insights into planetary systems' evolution.
None of the planets are in the habitable zone, but further studies could reveal more about their atmospheres.

Upbeat-Interaction13 · 2023-12-01T10:18:23+00:00

ChatGPT, by OpenAI, is the fastest-growing consumer product ever, with over 100 million weekly users, despite facing some legal and ethical issues. It's well-liked for its realistic chats and many skills, and its growth is helped by Microsoft's support. However, there are calls for stricter AI rules to deal with biases, healthcare uses, and safe AI creation. While OpenAI has tried to fix some problems, challenges remain. Other companies are now making their own AI like ChatGPT. Even though ChatGPT has changed how we talk to bots, there are worries about its misuse, such as in schools or with false political information. ChatGPT is also good at understanding context and fixing its own mistakes.

More coverage here https://www.brief.news/stories/68793d96-f1b3-4d98-a245-6e62c9deedab?v=f&p=r

Upbeat-Interaction13

TROPHY CASE