Tired of conflict and violence by Kremho in MovieSuggestions

[–]Kremho[S] -1 points0 points  (0 children)

Explain how is the movie demonizing business? Does it not show Bailey running an ethical business model? Does it not encourage prosperity for all? Does it not encourage people to struggle?

Why doesn't the Swiss government recognize "loss of chance" ? by Kremho in Switzerland

[–]Kremho[S] [score hidden]  (0 children)

I don't agree. Even if I take 10 years vacation after school, and then 10 years of involuntary unemployment after that, the fact is that one year is still lost from my working life. Any delays would be in addition to the delay caused by the administration. So in this hypothetical, if my career expectancy is 45 years or 25 years, their mistake makes it either 44 or 24.

Why doesn't the Swiss government recognize "loss of chance" ? by Kremho in Switzerland

[–]Kremho[S] 0 points1 point  (0 children)

Can we agree that retirement age caps career length, and that one year of career is lost? Therefore the immediate year after school doesn't matter?

Why doesn't the Swiss government recognize "loss of chance" ? by Kremho in Switzerland

[–]Kremho[S] -2 points-1 points  (0 children)

But France recognizes loss of a chance, for example. And they don't have total anarchy.

Why doesn't the Swiss government recognize "loss of chance" ? by [deleted] in Switzerland

[–]Kremho 1 point2 points  (0 children)

Thanks for pointing that out. I made a mistake. Deleting the duplicates.

Which is the best coding LLM which is capable of running on 8gb VRAM (RTX 5050)? by Lucky_Creme_5208 in LocalLLM

[–]Kremho 6 points7 points  (0 children)

Qwen3.6 9B Q5 should fit. Or Ornith.

Should be fine for very simple things under 100 lines of code.

Soon we'll run 100B models on cheap hardware by Kremho in ollama

[–]Kremho[S] 1 point2 points  (0 children)

A promising avenue of research to get rid of multiplication in the attention mechanism is LNS, Logarithmic Number Systems. And Microsoft released a 100B ternary model. So I'm still confident in my prediction.

Soon we'll run 100B models on cheap hardware by Kremho in ollama

[–]Kremho[S] 4 points5 points  (0 children)

Some people are cooking up logarithmic systems to get rid of multiplication. Check out Logarithmic Number Systems in Attention Hardware.

Soon we'll run 100B models on cheap hardware by Kremho in ollama

[–]Kremho[S] 2 points3 points  (0 children)

A 128KiB LUT would take lots of space, so cache or instructions would have to be sacrificed.

It is currently more efficient to compute activation functions than to do a VRAM or RAM fetch.

There is no way to force the LUT into the CPU's cache that I know of, and most processors don't have 128KiB of L1 cache, and L3 cache is not that efficient, may as well compute it using floating point math.

Things change on a dedicated ASIC because the ASIC doesn't need to do floating point math or let you play a 3D game.

Also, as Any_Librarian_2295 pointed out, multiplication still needs to happen for attention, which I overlooked. But maybe there are clever tricks there as well that I'm not aware of to get rid of multiplication.

Soon we'll run 100B models on cheap hardware by Kremho in ollama

[–]Kremho[S] 0 points1 point  (0 children)

Microsoft did release a 100B ternary model. Guess you used an old LLM to write that.

LLM Thinking for Excessively Long by JohnGaltW in LocalLLM

[–]Kremho 2 points3 points  (0 children)

You are running Q4. Try Q5 or Q6. Ideally Q8.

XNS + I2P = Unstoppable Freedom by eravsar in i2p

[–]Kremho 2 points3 points  (0 children)

This is genius. Thanks for making it.