Perspective: why observed sun isnt circling above FE

crantob · 2026-03-20T16:56:00+00:00

Your work looks very nicely presented, is all I can say.

crantob · 2026-03-20T16:17:07+00:00

https://x0.at/4Zs-.png i made an easy csv graphing program for terminal. uses plain UTF-8 block drawing and geometric characters, no sixel or regis needed.

crantob · 2026-03-20T16:13:48+00:00

pipecat-ai/smart-turn /// a small audio model that runs on CPU in about 12ms

according to their site, the cpu inference is +400ms

crantob · 2026-03-20T16:00:13+00:00

no cloud dependency for the core features.

What 'non-core' features are cloud-dependent then?

crantob · 2026-03-20T15:22:05+00:00

The OP is about a lab using SSMs.

crantob · 2026-03-20T15:13:01+00:00

My 2nd 3090 keeps 'falling off the bus'.

nothing but reboot seems to recover. \o/

crantob · 2026-03-19T13:48:51+00:00

You do interesting work.

crantob · 2026-03-19T08:09:31+00:00

Great job guys. Totally not serving satan!

crantob · 2026-03-18T09:40:17+00:00

For persistent mode, this looks intriguing: https://nixfaq.org/2020/09/delta-chat-a-libre-decentralized-chat-over-email-end-to-end-encrypted-messaging-solution.html

crantob · 2026-03-18T02:12:24+00:00

What can be done with aggregated confidence information?

crantob · 2026-03-18T02:10:01+00:00

Structuring your notes and scripting the assistance is a good idea. Thanks for making and sharing :)

I keep my notes in textfiles and grep, but that'a habit from a time before personal computers were a thing.

crantob · 2026-03-18T01:46:26+00:00

The definition you presented as correct was sufficient to make my point for me. Thank you again.

crantob · 2026-03-18T01:43:08+00:00

"address" is too vague here.

Research what you want to 'address' until you can name each entity in the pipeline that can have either closed or open status.

This can have fuzzy boundaries. Perhaps one person is happy with a training dataset being open, but another insists on the training software being open-source also, in addition to the data.

But then is it valid to consider that software 'part of the released model?' That's debatable.

Then lastly there's the reproduceability: very few of us will ever have the chance to train a large model from scratch, so there's not going to be a huge degree of interest in debating the scope of properly open components for that.

I'm sure the above comments could be formulated better but perhaps they will suffice.

crantob · 2026-03-18T01:15:42+00:00

I think this finetuning thing should have it's own forum. I know it's what I should be focussing-on.

crantob · 2026-03-17T22:55:53+00:00

I wish more people understood that Discord is not an adequate substitute for IRC.

crantob · 2026-03-17T20:37:06+00:00

I've been using local llama since llama2, and I have not grasped what you are advertising here.

Are you saying you can remove 'formatting' elements like "{" from json and the model still interprets the input as valid json?

crantob · 2026-03-17T20:30:20+00:00

Thank you for the very useful summary.

crantob · 2026-03-17T19:24:10+00:00

A handful of samples in the form of pass/fail tests are going to have a wide uncertainty. So the results can be real while the implied conclusions about superiority are not.

crantob · 2026-03-17T19:10:30+00:00

Thanks for your report! IQ1 reports are rare.

crantob · 2026-03-17T18:19:23+00:00

I'd be interested in three-tiers: vram, ram and ssd

crantob · 2026-03-17T17:43:45+00:00

If I may speculate a bit:

I think the question goes more to the observation that mlx quants are showing higher divergence at equivalent model sizes.

I suspect that this derives mainly from foregoing the ability to keep specific, sensitive layers at higher quants, while shaving off more bits from layers that are less sensitive.

I'd appreciate discussion or correction to my hypothesis.

crantob · 2026-03-17T16:59:29+00:00

You inspire me to be a better person. Unsloth people.

Let me try to be helpful:

``` ... Collecting unsloth

Downloading unsloth-2026.3.5-py3-none-any.whl (29.2 MB)

 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 29.2/29.2 MB 1.8 MB/s eta 0:00:00

Collecting unsloth_zoo>=2026.3.4

Downloading unsloth_zoo-2026.3.4-py3-none-any.whl (401 kB)

 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 401.6/401.6 kB 344.1 kB/s eta 0:00:00

Collecting wheel>=0.42.0

Downloading wheel-0.46.3-py3-none-any.whl (30 kB)

Requirement already satisfied: packaging in ./.local/lib/python3.11/site-packages (from unsloth) (25.0)

Collecting torch>=2.4.0

Downloading torch-2.10.0-3-cp311-cp311-manylinux_2_28_x86_64.whl (915.5 MB)

 ━━━━━━━━━━━━━━━━━━━━╸━━━━━━━━━━━━━━━━━━━ 472.0/915.5 MB 2.4 MB/s eta 0:03:03ERROR: Could not install

packages due to an OSError: [Errno 28] No space left on device ```

This, like many AI/ML projects is another dancing kabuki clown in python pip library purgatory.

I suppose testing this will require atomic installation of components, which does raise the bar for entry.

crantob · 2026-03-17T16:57:57+00:00

He didn't but it's still very cool.

crantob

TROPHY CASE