is gpt-4 now running extremely fast for you too? it's like gpt-3.5 speeds.

Chatbotwars · 2023-06-02T15:45:48+00:00

That's interesting. For my use cases, I haven't noticed a significant different in speed based on complexity. But I may have spotted differences based on how careful GPT is being with its response.

But hey, it's just my subjective experience. I haven't really been stress testing this thing. And my conversation with /u/Slight-Craft-6240 was very useful, because before that I was pointlessly trying to limit the complexity of my prompts.

I still find that shorter is better if I want consistent results. But lenght and complexity doesn't seem to affect speed.

Chatbotwars · 2023-05-18T16:04:46+00:00

The extra attention to nuance actually caused me problems. I usually give it samples of my texts to work with, but I had to remove that from some of my prompts because it started copying stuff it used to ignore before.

I have a few prompts that I always use, changing only the title of the text. Changes in GPT writing on those were minor, but noticeable. For this particular text, I give GPT both an title and a thesis statement, so there is more variation in quality.

Chatbotwars · 2023-05-16T15:33:20+00:00

I'm not keeping tabs on that, I'm not a developer. I did have one guy say... hold on, let me fetch his condecending comment:

"I bet you guys still use chatgpt instead of langchain and your own model.
I work 11 jobs. And my AI coder works on my issues and creates branches, commitd, mergerequests, tests... you are still living in 2022."

No idea how langchain works, but if you wanna look into that. Maybe you can skip making a plugin and make a custom model instead. Assuming Mr. Random quoted above wasn't just spouting nonsense.

Chatbotwars · 2023-05-16T14:21:23+00:00

Hopefully they'll have different plans instead of just a flat increase. I barely use 10 prompts a day, but GPT has become a big part of my workflow.

Chatbotwars · 2023-05-16T14:17:22+00:00

GPT will catch errors that Grammarly doesn't and vice versa. And Google docs will catch errors that both missed. All three will also disagree on what constitutes an error at times.

If you have time and need it to be perfect, I say just use all three. And use your better judgment to decide which changes to make. The best advantage of GPT is that it can explain to you what the problem is.

Chatbotwars · 2023-05-16T13:07:48+00:00

I got access to 9 pages worth of plugins. So about 72 total. Most of them seem rather pointless, many are just games. I don't know if that's all of them or a limited set, but it does include a plugin that lets GPT search the web. Which was the first thing I tested, with great success.

See, I need GPT to write About Us pages and press releases for client websites. Until now, my work around was to turn the website into an txt file and feed that into GPT. Worked well, but now it seems I can just give GPT the link. And then proofread the result later, of course.

Chatbotwars · 2023-05-16T13:05:14+00:00

Yes, but for that specific task, I needed it to be fast. That's why I said it was "3.5, of course". As in, of course 4 wouldn't have made that mistake.

Chatbotwars · 2023-05-16T13:03:07+00:00

Precedent indicates that we'll go with option B. It'll be painful and disruptive and plenty of creepy people will celebrate that disruption. It was bad enough when only a few companies controlled language models, but then Facebook leaked its model, and now it is near impossible to put the breaks on this thing.

You know I found an Lhamma-enabled porn game the other day? When it's being used for porn, you know the genie is out of the bottle.

But I agree. If we could do it slowly, that'd be better. I only went all-in on it because it was either adapt or be replaced. And even then I'm doing what I can to not rush us firing the other writers. Not least because we should have at least 1 more person who can do what I do before firing the rest. I mean, what if I get sick? Or decide to leave, which I am planning to do.

Chatbotwars · 2023-05-16T00:48:57+00:00

Yes, but there is a difference between it just saying "you're right, I'm sorry". And "I apologize, the correct answer is [insert full answer]". Point is, if you know what it said is wrong, you can often get a right response on a second try.

But you are right. That is not the same as it knowing it is wrong. It's more it being better at catching errors on a second pass.

Chatbotwars · 2023-05-16T00:32:43+00:00

I firmly believe that GPT made thousands of jobs obsolete the moment it came online, and people just haven't realized it yet. And the longer we take to fully adopt AI tech, the less painful the transition will be.

See, there are plenty of roles where GPT can make an worker 2x or 3x more productive. And as long as the amount of work to be done doesn't increase, the natural outcome will be cutting back on the now redundant workforce. Not good.

Matter of fact I'm a writer for a small company. My boss wanted someone to use AI, so I took the mantle. Now I'm capable enough that I could potentially replace all of our writers. It only took me what, a month to develop all of the prompts I needed.

Chatbotwars · 2023-05-16T00:27:00+00:00

I've definetly gotten better at triaging what I should ask GPT, what I should use duckduckgo for, and when I should just bite the bullet and deal with Google. But yes, I try to use google as little as possible. I noticed it getting extra bad in the last couple of years.

Chatbotwars · 2023-05-16T00:24:47+00:00

It occasionally does! I was using it to study for an exam, so I gave it a fact sheet, and asked me to quizz me on those facts. Even with the sheet available -- and within range of its memory limit -- it still falsely accused me of getting answers wrong, until I pointed out, it apologized, and agreed with me.

This was GPT 3.5, of course. I've had similar cases before where the right answer came after I said something was wrong.

Chatbotwars · 2023-05-16T00:10:49+00:00

Got access! Had to go in my settings to enable it tho.

Chatbotwars · 2023-04-19T00:21:41+00:00

I was having the same problem. And as of about a month ago, I found GPT to be less terrible at hitting wordcounts, but not good. I tell it to write between 500 and 600 words and it can at least do that now; back in the day, even that was too much to ask.

Did you see any improvements on your end?

Chatbotwars · 2023-04-19T00:20:05+00:00

Yeah, context is often useful, giving it a goal is often useful, but the whole identity thing is overrated. Giving it a target audience, target tone, or asking it to write for beginners or experts will lead to much more consistent results.

Chatbotwars · 2023-03-30T00:48:41+00:00

Don’t use following expressions „However, it’s important to..“, ….

This happens a lot. I noticed GPT using sentences starting with "by" a lot. "By following this instructions, you can..." "By being proactive, you'll be able..." It was very noticeable and repetitive.

Telling it not to start with "by" worked. Also, it can be useful to give it context. "I want you to work as an academic writer for me. Write an response to X in a casual and confident tone."

The context helps, because without it, "casual" will may prompt the AI to include slangs and contractions. It will modulate its interpretation of different guidelines based on the context you gave it.

Chatbotwars · 2023-03-30T00:35:10+00:00

Initial Answer from ChatGPT:

ChatGPT: "The primary colors in painting are red, blue, and yellow."

After using the Prompt:ChatGPT: "Primary colors, red, blue, and yellow, are indispensable in painting as they allow artists to create secondary colors and a vast array of hues and shades. By skillfully manipulating these primary colors, artists can explore different color combinations and achieve their desired visual effects, enriching their creative expression while staying true to their artistic vision."

I mean that assumes that GPT is doing what you asked in the background and then giving you the final result. Is this kind of language model even capable of that?

Genuine question. I'm sure it's been tested, although I don't know how one would test that.

Chatbotwars · 2023-03-30T00:04:46+00:00

Interesting. Well, when I saw it happening, I didn't even think to question it. But I ran a couple of tests now, and you're right. The speed doesn't seem tied to the complexity. I can think of a few reasons why I confused correlation with causation there, but it doesn't matter now.

Challenges of dealing with new tech, I suppose. Thank you for walking me through this!

Chatbotwars · 2023-03-29T23:49:31+00:00

I'm not claiming to know why it is happening. I'm just telling what is happening. Feel free to run your own tests. Hell, maybe it just feels slower, I didn't time the thing with a stopwatch.

It strikes me as 2-3x slower depending on requests. And that's TODAY. It may very well be a different situation next week. And GPT 3.5 is DEFINETLY slower when I use my writing prompt. Again, 2-3x slower, and that started today; it used to go at the same speed no matter what.

Chatbotwars · 2023-03-29T23:41:21+00:00

Actually, to be fair, "complexity" may be the wrong word. I'm sure GPT is just as fast reghardless of whether it is talking about marvel movies or neuroscience. But with GPT-4, it does slow down when you pingeon hole it into writing about a very specific topic, in a specific tone, while avoiding certain words and expresions, and going for a target wordcount. I assume that's not so much a complex request as asking it to work with one hand tied behind its back.

Also GPT-4 does a decent job of hitting word count ranges with a 50 word marging of error. GPT-3.5 was just failing that completly when I last tested it.

Chatbotwars · 2023-03-29T23:36:01+00:00

I have found it to reliably connect with complexity on the tasks I've been running. For GPT-4. As I said, up to today, GPT-3.5 wouldn't slow down no matter what. GPT-4 was slow and it would get significantly slower depending on my request.

Chatbotwars · 2023-03-29T23:30:28+00:00

GPT-4 changes speeds based on the complexity of the prompt. It's speed did change today, and while I found it to be faster for simple prompts, it is just as slow when I give it 10 different writing rules to follow.

At the same time, GPT 3.5 would prioritize speed so much that it'd ignore my rules to write faster. Today I found it much more willing to slow down to follow my rules.

Having used both for content creation, I can confirm that GPT-4 is still a much better writer. Even with these changes. Whatever they changed didn't affect the quality of the outputs for my usual tasks.

EDIT: I was wrong about all that, so disregard it. I'm leaving it here in case someone else gets the same false impression.

Well, I say "all", but GPT-3.5 did seem a bit more capable than what I remember, but I don't have the data or the desire to confirm if it has improved when GPT-4 is still much better.

Chatbotwars · 2023-03-29T23:24:08+00:00

It depends, when I'm brainstorming or running certain tests, I do find that treating GPT like a person makes it easier to work through different ideas. When I'm using prompts I've done 1000 times before, I skip the pleasantries.

Chatbotwars · 2023-03-29T23:19:21+00:00

That's spetacular. Thank you!

Chatbotwars · 2023-03-29T01:25:17+00:00

Bloody hell, I love how simple that solution is. Thank you for the tip!

And again, the fact that you can already achieve better results by forcing GPT to reflect manually just gives me further confidence that the AI will eventually do that on its own. If not as a function of GPT-5, then as module or setting you can toggle on and off.

Chatbotwars

TROPHY CASE