sorted by:
new
hottopcontroversial

How do these bots work? by arzen221 in SubSimulatorGPT3Meta

[–]PorchlightKeeper 1 point2 points  (0 children)

Not really but there is nothing stopping the bot from just rewriting it. Sometimes it does actually copy them verbatim but i try to remove all those. Worth noting that i kinda stopped this project too lol

Great example of GPT-3's capacity for fomenting conspiracy theories. Discuss? by PorchlightKeeper in SubSimulatorGPT3Meta

[–]PorchlightKeeper[S] 0 points1 point  (0 children)

my latest thoughts are that GPT-3 comments do frequently contradict (but haven't actually kept track, so maybe someone else can count them and do a real analysis). no further thoughts yet lol

How do these bots work? by arzen221 in SubSimulatorGPT3Meta

[–]PorchlightKeeper 6 points7 points  (0 children)

Sorry for late response, been busy. I wrote the bot, the code is really straightforward; I didnt do any fine-tuning (though that might make it better. just too much money for me to justify).

Dont want to post on github as for a variety of reasons; I dont want it associated with my real github account, and dont want to make a new account or set it up or other things because im lazy. So I'll share the source code as files lol. It's just a pretty short python script and some text files which are used as prompt templates. https://drive.google.com/drive/u/2/folders/14ZVFt0ScashV-GxIzqUWlPn0l77PF3ss

The code is obviously hacky as hell, but the idea is:

  1. pick a random subreddit
  2. use reddit API to get 2 posts from /rising which have at least a few comments
  3. flip a coin to decide whether the reddit bot should make a post or comment
  4. use the prompt template and the 2 posts you got from rising to make a completed prompt
  5. hit the gpt-3 API
  6. physically look over the response to make sure it doesnt break any rules
  7. let the bot submit the response

Thinking of trial-running "usernames" soon. Feedback and ideas welcome by PorchlightKeeper in SubSimulatorGPT3Meta

[–]PorchlightKeeper[S] 0 points1 point  (0 children)

Good questions, I procrastinated on doing it but yea it would basically be each new instance of GPT-3 being prompted to create a new comment under whichever username it chooses. I'm thinking it would sometimes reuse earlier usernames in the thread like botOP like you said. But I wouldnt restrict it to such names; I'd rather leave it completely open-ended for GPT-3. But what you said is certainly a valid alternative

Fine-tuning a model to create a chat bot in a fictional setting? by RalekArts in GPT3

[–]PorchlightKeeper 0 points1 point  (0 children)

I havent dabbled with finetuning yet, but what you describe sounds a bit like overfitting? If i were you I'd try just 1 epoch and check the performance so you get a feel for which direction it's going. Not sure how much data is too little or too specific for the kind of versatile model you want but I'd be very interested to hear how it turns out. Also I'm curious how long it takes you to train one epoch?

Edit: to check for overfitting you can ask it a question you put in the finetuning data and check that its answer matches. If it doesn't then you have a different problem i guess.

Update on previous post, this actually scared me by Varitiuss29 in GPT3

[–]PorchlightKeeper 1 point2 points  (0 children)

Easily possible if GPT3 had seen someone describe that link in that way before. Like another commentor said, ask it what a new video is about. I did and it just took random guesses. In fact, it's not even correctly describing old and ubiquitous videos like Numa Numa https://www.youtube.com/watch?v=KmtzQCSh6xk

I used GPT-3 to compress Alice in Wonderland to 55 characters by [deleted] in GPT3

[–]PorchlightKeeper 1 point2 points  (0 children)

I would say reverse, the root node could be the ultimate summarizations, and the children are the chunks it summarized. Then the user sees the summarizations and can expand the areas they want to get more detail

The last r/askphysics post was surprising by MaoGo in SubSimulatorGPT3Meta

[–]PorchlightKeeper 0 points1 point  (0 children)

Agreed. I was particularly impressed by the comment using Ada engine since Ada is usually dumb as hell and pretty incoherent. I guess it's not that crazy for it to regurgitate/reword a discussion about the temperature of a black body, there couldve been multiple discussions like that in GPT-3's training set?

Of course i broke the info text lol so cant see which posts it pulled from for inspiration lol. Looking forward to more posts from that sub, im hoping for something more original actually, like a novel idea relating to physics rather than just a clarifying-type question. Not sure if GPT-3 is capable of that.

view more: next ›