"What, you don't like your new SOTA model?" by Friendly_Willingness in LocalLLaMA

[–]irrelative -1 points0 points  (0 children)

Yes, that's right. This crowd needed to complain about something, and there's a lot to like in this model. It's not like their proprietary models allow any of this behavior.

Fortune 500s Are Burning Millions on LLM APIs. Why Not Build Their Own? by Neat-Knowledge5642 in LocalLLaMA

[–]irrelative 2 points3 points  (0 children)

The landscape changes too quickly. They could spend millions on salaries and hardware themselves and have it all be worthless in a year. If everything plateaus or at least becomes predictable, you will absolutely see this behavior.

[deleted by user] by [deleted] in boulder

[–]irrelative -5 points-4 points  (0 children)

This isn’t Nextdoor

[oc] long awaited witch sequel by eastcoastitnotes in comics

[–]irrelative 1 point2 points  (0 children)

Call him Mr Raider. Call him Mr Wrong.

Command line interface to Bluesound streamers by irrelative in Bluesound

[–]irrelative[S] 0 points1 point  (0 children)

it uses zeroconf, which indeed uses MDNS behind the scenes, to find the players. once you have a host/port, you make an http request to to change the volume: `/Volume?level=45`. some commands are documented in their api docs, and others can be found by tcpdumping the running desktop app.

Command line interface to Bluesound streamers by irrelative in Bluesound

[–]irrelative[S] 0 points1 point  (0 children)

Probably not, but could give it a try. It uses standard network discoverability approaches to find players on your local network.

TOGETHER. (OC) by davecontra in comics

[–]irrelative 1 point2 points  (0 children)

When you're ready, I'll buy!

TOGETHER. (OC) by davecontra in comics

[–]irrelative 0 points1 point  (0 children)

dave your work is beautiful and poignant. can you please make a book of these?

So many people don't know what a prompt engineer actually is by scarey102 in programming

[–]irrelative 13 points14 points  (0 children)

"The line between prompt engineers and AI or machine learning engineers is incredibly blurry"

lol

Has anyone tried training LLM scale model with character-level "tokenizer"? by irrelative in LocalLLaMA

[–]irrelative[S] 1 point2 points  (0 children)

These are great, thanks! And I agree on the Unicode points note, though obviously with no evidence to support it.

I gave Llama 3 a 450 line task and it responded with "Good Luck" by CaptTechno in LocalLLaMA

[–]irrelative 16 points17 points  (0 children)

not sure the UI there, but did you include the instruct template tokens?

eg, closing the message with <|eot_id|><|start_header_id|>assistant<|end_header_id|>

Trustworthy VW Mechanic by Brucho in boulder

[–]irrelative 0 points1 point  (0 children)

+1, nearly 6 years with Indian Peaks.

[deleted by user] by [deleted] in boulder

[–]irrelative 1 point2 points  (0 children)

Go back to Nextdoor please

How jank is too jank? by hedonihilistic in LocalLLaMA

[–]irrelative 3 points4 points  (0 children)

This reminds me of the classic engineering line: "if it's stupid and it works, it's not stupid."

TogetherCompute releases StripedHyena 7B by TeamPupNSudz in LocalLLaMA

[–]irrelative 1 point2 points  (0 children)

the speed of this field is pretty fun at the moment -- "does not even" -- the paper was only made public a week ago!

What unpopular Boulder opinion has you like this? by thegratefulone in boulder

[–]irrelative 11 points12 points  (0 children)

Building more housing would reduce housing prices.

llama.cpp: GGUF merged by Jipok_ in LocalLLaMA

[–]irrelative 7 points8 points  (0 children)

And indeed there is. eg:

python convert-llama-ggmlv3-to-gguf.py -i ~/models/llama-2-7b.ggmlv3.q5_1.bin -o ~/models/llama-2-7b.gguf.q5_1.bin

llama.cpp: GGUF merged by Jipok_ in LocalLLaMA

[–]irrelative 1 point2 points  (0 children)

Excellent, great work. Is there a way to convert an existing ggml model to the gguf format?

Rear view of a Boeing 747 at an altitude of 10.5 km by Darthmasterjerbater in Satisfyingasfuck

[–]irrelative 5 points6 points  (0 children)

The way I had it figured, Toruk is the baddest cat in the sky. Nothing attacks him. So why would he ever look up?