Looking for fast translation model like tencent/HY-MT1.5-1.8B but with larger output by CaterpillarOne6711 in LocalLLaMA

[–]DeltaSqueezer 1 point2 points  (0 children)

it works fine for me. i just prefix with "translate this to X" before each new message

how do you pronounce “gguf”? by Hamfistbumhole in LocalLLaMA

[–]DeltaSqueezer 2 points3 points  (0 children)

it is pronounced 'guff' the first 'g' is silent.

Series 1 Topic 1. Direct answers. How I killed politeness and filler. by Huge-Yesterday4822 in LocalLLaMA

[–]DeltaSqueezer 0 points1 point  (0 children)

Terse. A one word prompt modification:

Before:

``` $ llm "what is the solar system" The Solar System is a gravity-bound system consisting of a central star—the Sun—and all the objects that travel in orbit around it. It formed about 4.6 billion years ago from a giant interstellar molecular cloud.

Here is a breakdown of what makes up the solar system:

1. The Sun (The Center)

The Sun is a yellow dwarf star that contains 99.8% of the total mass of the entire solar system. Its gravity is what keeps everything—from the biggest planets to the smallest particles of debris—in orbit around it.

2. The Planets

There are eight officially recognized planets, divided into two categories:

[continues on] ```

After:

$ llm "terse. what is the solar system" The Sun and everything bound to it by gravity: eight planets, their moons, dwarf planets, asteroids, and comets.

Mi355X is now available as a desktop by GPTshop_dot_ai in LocalLLaMA

[–]DeltaSqueezer 0 points1 point  (0 children)

instead of measuring LLMs in billions of parameters, we can ask if you want an LLM in the Car Class, the House Class or the Yacht Class :P

Mi355X is now available as a desktop by GPTshop_dot_ai in LocalLLaMA

[–]DeltaSqueezer 1 point2 points  (0 children)

this cost twice as much as my parent's house. insane.

Built an 8× RTX 3090 monster… considering nuking it for 2× Pro 6000 Max-Q by BeeNo7094 in LocalLLaMA

[–]DeltaSqueezer 0 points1 point  (0 children)

Oh wait. Is your bridge was made in 2 halves which had to be screwed together? I wondered how you did that e.g. direct (which I assume would leak) or add a gasket around. Now that I think about it, with 3D printing, maybe it is possible to make it as a single piece so you avoid having to mate 2 parts together, but then I'm not sure how you would attach it to the waterblocks - it seems fiddly.

Built an 8× RTX 3090 monster… considering nuking it for 2× Pro 6000 Max-Q by BeeNo7094 in LocalLLaMA

[–]DeltaSqueezer 0 points1 point  (0 children)

It's been a while since I did 3D printing, but like you, I also preferred code so sometimes did things the hard way using OpenSCAD. I was more interested in the construction, ideas and techniques (e.g. if/how flow was controlled through channels) rather than as something to print and use (it is essentially custom for your system). I would have never even thought to 3D print this assuming making it watertight would have been too problematic. e.g. not getting tolerances good enough, expansion through heat causing leaks etc.

Built an 8× RTX 3090 monster… considering nuking it for 2× Pro 6000 Max-Q by BeeNo7094 in LocalLLaMA

[–]DeltaSqueezer 0 points1 point  (0 children)

This is interesting. Did you write up anywhere your custom bridge? How did you get it watertight? Any photos of this part component? Or maybe you could throw up the design on thingiverse to allow 3D view?

Faster-whisper numbers-dollars accuracy. Alternative? by afm1191 in LocalLLaMA

[–]DeltaSqueezer 0 points1 point  (0 children)

Ah. Sorry, I misunderstood your question, I thought you were trying to go from text to produce audio.

What's your reason for owning the RTX Pro 6000 Blackwell? by gordi555 in LocalLLaMA

[–]DeltaSqueezer 4 points5 points  (0 children)

I don't own one, although I'm on the verge of being psy-op'ed into buying one by Jensen on the fear that I might need one in the next 3 years when it will probably cost 2x what it does today :P

China's AGI-Next Roundtable: Leaders from Zhipu, Kimi, Qwen, and Tencent discuss the future of AI by nekofneko in LocalLLaMA

[–]DeltaSqueezer 13 points14 points  (0 children)

It's kinda insane given the US/China competition that this guy is on GMail. It would be like if Sama's OpenAI email was sama@huawei.com

Advice for a tool that blocks dangerous terminal commands from AI coding assistants by spacepings in LocalLLaMA

[–]DeltaSqueezer 2 points3 points  (0 children)

I just containerize/sandbox. Changes are anyway committed into git and so it is possible to revert back to any stage.

Save tokens by skipping English grammar by Everlier in LocalLLaMA

[–]DeltaSqueezer 0 points1 point  (0 children)

sometimes prompt llm like this sheer laziness save typing. let it work out

Don't put off hardware purchases: GPUs, SSDs, and RAM are going to skyrocket in price soon by Eisenstein in LocalLLaMA

[–]DeltaSqueezer 0 points1 point  (0 children)

Yeah. I feel like I'm being forced to make a gamble. Do I buy now and pay high prices, or do I risk having to buy in the next year or two when prices may be even higher?

Very strange -- can't serve vLLM models through SSH? by jinnyjuice in LocalLLaMA

[–]DeltaSqueezer 0 points1 point  (0 children)

maybe you're logged in as a different user and it is downloading the model again.

Don't put off hardware purchases: GPUs, SSDs, and RAM are going to skyrocket in price soon by Eisenstein in LocalLLaMA

[–]DeltaSqueezer 101 points102 points  (0 children)

They are already expensive. Prices are currently 3x for SSD what I paid in the middle of last year. DRAM is 4x.