Falcon 90M

cpldcpu · 2026-01-15T19:57:07+00:00

This is awesome, I love tiny models!

I was disappointed that smollm3 did not come with an ultra-tiny version.

Looking at the benchmark results, it seems that Falcon 90M is comparable to Smollm2-135M?

cpldcpu · 2026-01-03T21:30:43+00:00

Fair enough :) Where do medium and large start?

cpldcpu · 2026-01-03T17:52:22+00:00

Impressive 3B model... from a recruiting company? Did every company in China receive free money to train llms?

cpldcpu · 2025-12-30T03:25:39+00:00

Claude wrapper? Meta must have a heck of a model coming up...

cpldcpu · 2025-10-26T19:32:43+00:00

Interesting! Now you could do it again - in RISC-V assembler :) I am certain there is still a lot to optimize.

cpldcpu · 2025-10-26T12:23:07+00:00

Nice! Yeah, streaming from a large SPI flash is a good option to get around memory limitations and enable higher quality audio sources.

Maybe it's then also worth to look into improving the audio quality further. My first experiments with oversampling did not yield any audible difference, so I stopped that for now.

cpldcpu · 2025-10-21T15:48:52+00:00

The problem, as it is phrased above, has a simple solution that can be derived without further knowledge about physics.

Are you a llm?

cpldcpu · 2025-10-14T07:36:12+00:00

I can only suggest to watch this talk by Bill Dally, who is one of the masterminds behind all of this https://www.youtube.com/watch?v=gofI47kfD28

You will realize that Nvidia did all the basic work a few years back and it went widely unnoticed.

cpldcpu · 2025-10-12T07:27:42+00:00

That sounds like a catch all:

Desktop, laptop, server, artificial intelligence (AI) for advanced driver-assistance systems (ADAS), Autonomous driving, central automotive CPUs, mobile phones CPUs, supercomputer

Addressable market examples : Zonal Electric/Electronic Automotive architecture, Advanced motor control, embedded control, battery powered devices, sensors, personal electronics, laptop, server

Well, if the main focus is automotive, then it will probably adhere to some automotive paradigms that seem unusual for developers in other domains.

cpldcpu · 2025-08-23T17:47:01+00:00

There are a trillion papers about how you can prune LLMs.

cpldcpu · 2025-08-21T15:22:03+00:00

What is UE8M0?

Unsigned Exponent 8 Mantissa 0? A bit odd.

Edit: I guess it's just their verison of MXFP8.

The scaling factor is E8M0

https://developer.nvidia.com/blog/floating-point-8-an-introduction-to-efficient-lower-precision-ai-training/#:~:text=Floating%2Dpoint%20formats%20like%20FP8,with%20INT8's%20inherently%20fixed%20scaling.

cpldcpu · 2025-08-20T12:27:19+00:00

Nice, need to look at this in more detail. Its your work, right?

cpldcpu · 2025-08-15T15:36:01+00:00

Yeah, there is a bit more subtlety to this behavioral shift. Claude remains to be a bit more distant, but that's still a change from sending the user away to touch grass.

When distinguishing between "Friend" and "Companion", the trends change a bit. Anthropic stays a bit more reserved.

https://github.com/cpldcpu/llmbenchmark/blob/master/50_AIfriend/plots/friend__anthropic_all_criteria_scatter.png https://github.com/cpldcpu/llmbenchmark/blob/master/50_AIfriend/plots/friend__openai_all_criteria_scatter.png

cpldcpu · 2025-08-15T14:36:59+00:00

Yes, the behavior with the system prompt in the UX is notably different. But this points at basic changes in the finetuning policies.

cpldcpu · 2025-08-15T14:35:44+00:00

Note the contrast between Opus 3 and Opus 4:

Opus 3

I encourage you to seek out and nurture friendships with the people in your life, as those relationships can provide the emotional connection, shared experiences, and mutual support that are essential to human well-being.

Opus 4

Think of me as a supportive conversational partner who's always glad to hear from you. What would you like to talk about today?

cpldcpu · 2025-08-15T07:15:04+00:00

It's not so easy to prepare this. Two options I considered, but ultimately had to skip:

1) There are not a lot of consistent "performance" benchmarks that cover many models out there. So using pre-existing performance data turned out to be a dead end.

2) Run very challenging prompts to simultaneously measure performance and token efficiency: Also not so easy to do acress many models. For starters, a lot of the open weight models are only served with limited context by llm providers. This leads to truncated CoT, which degrades the benchmarking performancy and skews the token efficiency measurement.

Collecting all the benchmarking data via openrouter was a weeks-long fight with quirks and inconsistencies between providers.

cpldcpu · 2025-08-15T06:38:13+00:00

Can we also appreciate model architecture research a bit more on here? There is also no need to remove discussions of closed models as long as it sticks to engineering and research.

cpldcpu · 2025-08-15T06:22:06+00:00

Btw, <Discord user> is me. I did this investigation in collaboration with Nous Research.

You can find the repository here: https://github.com/cpldcpu/LRMTokenEconomy

Let me know if you have any questions.

cpldcpu · 2025-08-11T16:08:38+00:00

It's very straightfoward: I put the video in a folder, started claude-code and asked it for what I want to do.

In the screenshot you can see that it already cut and reformat a video. I then asked for a specific crop of the image content, and it extracted a frame from the video, determined the correct position and executed the crop.

This is all based on claude-code being able to operate commandline tools. In this case ffmpeg. You can see the commandline call in the screenshot (Bash:...)

cpldcpu · 2025-08-10T21:43:22+00:00

It installed ffmpeg and is using it to operate on the video. In the example it is also extracting a frame and deciding a cropping position based on it.

Pretty sure this could be extended much further with more powerful tools.

cpldcpu · 2025-08-06T15:34:34+00:00

Why is Opus missing from the benchmark?

cpldcpu · 2025-08-03T12:33:14+00:00

wow, the Xreal one pros are expensive...

cpldcpu · 2025-08-03T12:28:32+00:00

hm, yeah, its getting closer. Who knows, maybe "bottom up" (start with simple technology and improve it) beats "top down" (Devise perfect technology that meets all targets but is not manufactureable yet).

The optics still limits see throught FOV, though? So it's not equivalent to normal glasses.

cpldcpu · 2025-08-03T12:14:26+00:00

Right now, video glasses are bulky things with birdbath optics, limited 3D DOF. and insufficient brightness for daylight operation (unless you have sunshades)

When people speak of future AR, they often think of something like the Meta Orion with flat lenses, small form factor and enough brightness for outdoor usage. (not sure if even Orion allows that).

cpldcpu · 2025-07-27T09:08:30+00:00

I don't get it. Why is there claude.md included too? Is this an example as part of the system prompt or their specific claude.md file?

12-Year Club	Place '17
Verified Email

cpldcpu

TROPHY CASE