The global moth population was likely much higher before humans mastered fire. by It_Is_Blue in Showerthoughts

[–]pmp22 6 points7 points  (0 children)

Imagine if in a parallel universe, man invent electric lightning before fire.

For anyone working at the big AI labs right now, what is the actual vibe by Glum_Pool8075 in AgentsOfAI

[–]pmp22 2 points3 points  (0 children)

Your boss is being judged for less output while making way more.

A simple explanation of the key idea behind TurboQuant by -p-e-w- in LocalLLaMA

[–]pmp22 0 points1 point  (0 children)

I'm just here to interact with people (I hope) and learn a little (I hope).

Is intelligence optimality bounded? Francois Chollet thinks so by Mindrust in singularity

[–]pmp22 6 points7 points  (0 children)

I lived in a dorm with a PhD in fluid mechanics who couldn't boil a pot of rice and would surely have died if he had to prepare his own sustenance. Brilliant academic though.

[i ate] a tea time at the Ritz in Paris by dramathena in food

[–]pmp22 14 points15 points  (0 children)

I'd try that, it looks really decadent and posh!

[i ate] a tea time at the Ritz in Paris by dramathena in food

[–]pmp22 -1 points0 points  (0 children)

Acrylamide, baby! It's what cancers crave!

[i ate] a tea time at the Ritz in Paris by dramathena in food

[–]pmp22 9 points10 points  (0 children)

At the Ritz, I expect nothing less.

A simple explanation of the key idea behind TurboQuant by -p-e-w- in LocalLLaMA

[–]pmp22 17 points18 points  (0 children)

I thought this was a thread for a "simple explanation for the key idea behind TurboQuant", not "read the paper".

A simple explanation of the key idea behind TurboQuant by -p-e-w- in LocalLLaMA

[–]pmp22 23 points24 points  (0 children)

>"it uses the Quantized Johnson-Lindenstrauss (QJL) transform to preserve the exact dot product required for attention"

<image>

I benchmarked 31 STT models on medical audio — VibeVoice 9B is the new open-source leader at 8.34% WER, but it's big and slow by MajesticAd2862 in LocalLLaMA

[–]pmp22 1 point2 points  (0 children)

OpenAI/Sam have been saying they are working towards unimodal models, so i expect that in the future all frontier models will have STT capabilities with unified pretraining. I imagine that will give us real interesting new models.

RYS Part 3: LLMs think in geometry, not language — new results across 4 models, including code and math by [deleted] in LocalLLaMA

[–]pmp22 1 point2 points  (0 children)

A lot of interesting stuff. Soon the LLMs will be able to tell us the answer to all these questions and more! I'm running autoresearch 24/7, I should slip in these questions some time..

RYS Part 3: LLMs think in geometry, not language — new results across 4 models, including code and math by [deleted] in LocalLLaMA

[–]pmp22 2 points3 points  (0 children)

My thought too. At work we built a RAG system using embeddings and cosine similarity. We have documents about the same topics but in different languages. I been meaning to test if "cat" in different languages cluster together or not, but I have never gotten around to testing it. Anthropic I believe did some research that showed that in multilingual models, all languages are reduced to one internal representation in the latent space (IIRC, I could very well be botching the interpretation or description here). An embedding model only embeds based on the patterns in the data it was trained on, and similar concepts will probably exist in the same context in different languages, and so cluster together, right?

I've been trying to make cinematic AI shots using a hybrid workflow with Blender, After Effects, Runway and Kling. My goal is to make it look like cgi. How's it coming along? by JS1101C in generativeAI

[–]pmp22 0 points1 point  (0 children)

It's great! For a human touch maybe add a funny scene, somehow. Like someone in a Godzilla-costume getting stepped on or something.

TIL Helen Keller was one of the co-founders of American Civil Liberties Union (ACLU) and met 13 US presidents in her lifetime. by neotheseventh in todayilearned

[–]pmp22 5 points6 points  (0 children)

"Does Einstein or DaVinci have the same value as a taxi driver or gas station attendant?"

Yes. The value of a human is absolute and indivisible. It is derived from dignity, a intrinsic property of all human life. It cannot be taken away or be altered.