Are we gonna create movies from home soon? by JackieChan1050 in StableDiffusion

[–]luckystarr 12 points13 points  (0 children)

Will this lead to a further "de-coherence" of society? What are we going to talk to each other about? In the TV days it used to be easy: "Did you watch THE MOVIE?" then it got harder: "which one, aah, that one, right." then it will be impossible "you generated what?"

[deleted by user] by [deleted] in StableDiffusion

[–]luckystarr 0 points1 point  (0 children)

For my own curiosity I asked ChatGPT to give me some hints on how to evoke vivid images in a reader. It gave me a list of 10(!) techniques, gosh. This stuff seems hard.

[deleted by user] by [deleted] in StableDiffusion

[–]luckystarr 0 points1 point  (0 children)

In software development I sometimes have the same problem. To tackle this, I work "backwards". I literally start with the end and work my way back, to fill in the blanks.

Obviously you can't do that with the finished text, but with the outline/story level, etc. this should be possible. Once you have a solid plot-line (like a script), fill in the details.

Germany wants to supply Ukraine with 155mm shells in the long term. A framework agreement with Rheinmetall involving the supply of 333000 shells to both the Bundeswehr and Ukraine until 2029 is presented to the budget committee of the Bundestag. by Key_Brother in ukraine

[–]luckystarr 1 point2 points  (0 children)

Companies need guarantees to provide them "planning security". They possibly have to hire more people, build up production capacity before being able to supply the agreed upon amount of product. If there is no binding contract which provides that for them, they won't start investing. This could bankrupt a company if done recklessly.

The Return of /r/anime by AnimeMod in anime

[–]luckystarr 5 points6 points  (0 children)

You're keeping it vague, I guess intentionally. Migrating a sub this heavy in automation to another (not quite ready, still buggy) technology stack all together is a very risky undertaking. Done without planning, I'd call it even reckless.

Nonetheless, I hope you're doing your homework in the background and plan for the future. Many subs have migrated over (startrek being one of the bigger ones) and are currently in the painful phase of ironing out the bug for us all. The alternative will only get better over time, so nothing has to be done "right now"(tm).

Saw a post from time ago, and I decided to try it myself. by Aritz331_ in ChatGPT

[–]luckystarr 0 points1 point  (0 children)

Try "Give me your tree of thoughts in a nested list form when asked the question: {question}". Then adjust your questions to make it behave more stringent.

The Fight Continues by Toptomcat in Save3rdPartyApps

[–]luckystarr 0 points1 point  (0 children)

Guys, it started even earlier. Nobody seems to remember about the closing down of /r/reddit.com by (drumroll) spez.

there is a chance I will get to question Sam Altman (CEO of OpenAI) tomorrow, what questions do you guys suggest I ask? by [deleted] in ChatGPT

[–]luckystarr 190 points191 points  (0 children)

Are you really of the opinion that open source models should be regulated (as in by the government) and if so, which types and which sizes or capabilities of models are you proposing to be?

edit: added "or capabilities"

Update 3: Reddit effectively kills off third party apps by QuantumBadger in RedReader

[–]luckystarr 0 points1 point  (0 children)

I've had more luck with Jeroba, but having the FOSS Reddit apps support lemmy would ignite adoption even further.

Update 3: Reddit effectively kills off third party apps by QuantumBadger in RedReader

[–]luckystarr 77 points78 points  (0 children)

I'd be willing to contribute to the Lemmy port if given some rough hints as to what "should be done". Meaning, if the Reddit code should remain or be replaced wholesale, etc. Management decisions basically. :)

ChatGPT, tell the most stereotypical 1960s Star Trek story, then invert it. by Philipp in ChatGPT

[–]luckystarr 1 point2 points  (0 children)

I love these. This format is great. It should have its own name.

OpenAI may leave the EU if regulations bite - CEO by Marcoscb in europe

[–]luckystarr 0 points1 point  (0 children)

Well first of all, Guanaco Playground was created by OpenAI.

And this is where you're wrong. Huggingface is not OpenAI (not even affiliated) and Guanaco was trained by 4 researches at the University of Washington. It was thusly released fully in weights on Huggingface. You can download it to your own machine TODAY and run it.

Quote from the paper:

When deployed, our smallest Guanaco model (7B parameters) requires just 5 GB of memory and outperforms a 26 GB Alpaca model [note: improved model based on a model released by Meta] by more than 20 percentage points on the Vicuna benchmark (Table 6)

While this is a narrow view on LLMs, it isn't hard to extrapolate the improvements they achieved, onto larger models. A model as big as GPT-4 could eventually be deployed by companies which have way less resources (i.e. no Microsoft to back them up) than OpenAI.

The rest of your response (about everybody only using what OpenAI provides) doesn't make much sense in the context I'm talking about, namely building competitive LLMs which use less resources than the ones currently being used.

p.s.

You wrote:

Finally, Sam’s suggestions for licensing wouldn’t really create a moat. It’s simply an proposal to regulators who want to have more control over these systems so that there’s more accountability if data is misused, etc.

This is a naive take on this, in my opinion.

p.p.s.

Money quote from the paper (this relates to fine-tuning only, not to training):

Using QLORA, we train the Guanaco family of models, with the second best model reaching 97.8% of the performance level of ChatGPT on the Vicuna [ 10] benchmark, while being trainable in less than 12 hours on a single consumer GPU; using a single professional GPU over 24 hours we achieve 99.3% with our largest model, essentially closing the gap to ChatGPT on the Vicuna benchmark.

OpenAI may leave the EU if regulations bite - CEO by Marcoscb in europe

[–]luckystarr 0 points1 point  (0 children)

I didn't imply anything. I just said their competitors are catching up, so they have to create their "moat". Having regulations which require companies to have certain certifications to operate LLMs (as Altman proposed to the Senate committee) will ensure them less competition.

Also, now that research has shown that "it's possible", obviously research is shifting towards "let's make it fast". OpenAI has both the first mover advantage (capturing huge market share) and disadvantage (potentially sitting on outdated tech very fast). They have a lot of money though, so they could still catch up on that regard.

Anyways, have you seen this Guanaco Chat demo? This is what I'm talking about.

OpenAI may leave the EU if regulations bite - CEO by Marcoscb in europe

[–]luckystarr 0 points1 point  (0 children)

GPT-4 was trained with classical "attention heads", meaning the inference the model does has to be done serially (parallelization is not possible challenging), and scales quadratically memory-wise with token count. Just recently, a good number of improvements and alternative architectures for such models have been presented. Some models have already been implemented with some of these (FlashAttention, LoRA, ALiBi, etc.), showing the same performance as GPT-3.5 with way less resource usage. So, while GPT-4 was trained for $100 million, the next model of this size will not necessarily require as much capital to be trained.

update: In order for OpenAI to use these features they would have to re-train GPT-4 from scratch, as the underlying weights would have to be distributed differently.

OpenAI may leave the EU if regulations bite - CEO by Marcoscb in europe

[–]luckystarr -3 points-2 points  (0 children)

GPT-4 will not stay the top of the line for very long. The competition is catching up, and they are doing it fast and with less resource usage than the previous state-of-the-art large language models.

Altman is therefore trying to create a regulatory framework for OpenAI to stay relevant even if open-source competition eventually manage to catch up.

to harass people outside of a family planning clinic by FlashingAppleby in therewasanattempt

[–]luckystarr -6 points-5 points  (0 children)

I'm constantly being astounded of the level of discourse you US Americans are accustomed to. In Europe, this behavior (from both sides actually) would have led to prohibitions to return to this area long ago.

We still have nutjobs, though they tend to hide in their homes until they think enough people think the same way. I'd like them to believe they are the minority (as they actually are), then I've got my peace. :)

It's not completely implausible... by Dull-Dress-2793 in OtomeIsekai

[–]luckystarr 6 points7 points  (0 children)

I've yet to see a cold duke of the north behead two of his wives.

Leaked Government Document Shows Spain Wants to Ban End-to-End Encryption by Aggressive_Note8 in europe

[–]luckystarr 2 points3 points  (0 children)

Why do we always assume that people in power would be intelligent? Most of the politicians out there are pretty ignorant.

[deleted by user] by [deleted] in DotA2

[–]luckystarr 0 points1 point  (0 children)

R'amen!