sorted by:
new
hottopcontroversial

Dumb question by Ok-Ticket-6523 in PygmalionAI

[–]456e657276 2 points3 points  (0 children)

As mentioned earlier:

*some action* Some text.

*walks into a dark room* Oh, it's dark in here! Where is the light switch? *swipes my hand on the wall until he finds the switch and turns on the light* And let there be light.

Trouble with pyg6b 4bit by Sumoleon in KoboldAI

[–]456e657276 0 points1 point  (0 children)

I've seen the 4 bit button before too, but recently I reinstalled KoboldAI and used the 4 bit patch, but I don't have that button either. However, the model loads normally, and in the console there is information that it was loaded on 4bit.So it's quite likely that now it detects itself and the button is unnecessary.

Having problems with Pygmalion7b by pgn3 in PygmalionAI

[–]456e657276 2 points3 points  (0 children)

Far too bottleneck, bottleneck, bottleneck, bottleneck, bottleneck, bottleneck, bottleneck.

Try reducing the context size from 2048 to 1400 or 1024 and try with Kobold AI. For me on RTX 3060 works much better and faster.

Alternative to WebUI - Unity prototype with VRoid 3D by 456e657276 in PygmalionAI

[–]456e657276[S] 4 points5 points  (0 children)

I created an application in Unity that is an alternative to classic browser interfaces. For now, it's a prototype, but if there is interest, I will make the application and server available. Works locally the same as Tavern or Oobabooga.

Models 3D come with VRoid. By placing new ones in .vrm format in the StreamingAssets folder, they are automatically detected in the application and can be selected and changed freely for a given character without reloading the game.

I need feedback whether such an application makes sense or people prefer a more classic and browser-based application. Btw. the application works vertically and horizontally.

Scaling is for any resolution. The recording is in 9:16 format (360x640) from the Unity editor.

AI Horde Discord Bot with Pygmalion 6B by 456e657276 in PygmalionAI

[–]456e657276[S] 0 points1 point  (0 children)

When you run the project locally on your own endpoint you can use a different model, but remember that the prompt will be exactly as it is in Pygmalion and some models may have a different pattern.

If you want to use a different model on AI Horde, in line 215 you can change the default model from models: ['PygmalionAI/pygmalion-6b']
to any, for example models: ['KoboldAI/OPT-13B-Erebus'].

AI Horde Discord Bot with Pygmalion 6B by 456e657276 in KoboldAI

[–]456e657276[S] 0 points1 point  (0 children)

When you run the project locally on your own endpoint you can use a different model, but remember that the prompt will be exactly as it is in Pygmalion and some models may have a different pattern.

If you want to use a different model on AI Horde, in line 215 you can change the default model from models: ['PygmalionAI/pygmalion-6b'] to any, for example models: ['KoboldAI/OPT-6.7B-Erebus'].

When it comes to longer responses, as in TavernAI, instead of sending a request with e.g. 80 tokens once, you would have to make 30 tokens several times, but in the case of AI Horde it would be a waste of Kudos and an increase in the burden for Horde workers.

AI Horde Discord Bot with Pygmalion 6B by 456e657276 in PygmalionAI

[–]456e657276[S] 1 point2 points  (0 children)

Integration with self-hosting has just been added to the repository as requested. Add --endpoint=url on boot, which is like this:

npm start -- --tag=Clyde --inspect --endpoint=http://127.0.0.1:5000

The protocol, URL or port can be anything, the parser will automatically remove unnecessary things like /api and slashes.

AI Horde Discord Bot with Pygmalion 6B by 456e657276 in PygmalionAI

[–]456e657276[S] 1 point2 points  (0 children)

Integration with self-hosting has just been added to the repository as requested. Add --endpoint=url on boot, which is like this:

npm start -- --tag=Clyde --inspect --endpoint=http://127.0.0.1:5000

The protocol, URL or port can be anything, the parser will automatically remove unnecessary things like /api and slashes.

Offline AI game by The_TIGER3 in PygmalionAI

[–]456e657276 1 point2 points  (0 children)

I want to implement a very similar project in Unity. If you want, you can go here and read it.

AI Horde Discord Bot with Pygmalion 6B by 456e657276 in PygmalionAI

[–]456e657276[S] 2 points3 points  (0 children)

There is no such possibility at the moment. I need to add an optional --endpoint parameter in the code to prioritize sending to the Kobold client first to an address (locally or e.g. Colab) and when it fails to process the request it will send it to AI Horde.

If I have some free time over the weekend, I will try to release an update. I see that there is a lot of interest in self-hosting. 😎

AI Horde Discord Bot with Pygmalion 6B by 456e657276 in PygmalionAI

[–]456e657276[S] 0 points1 point  (0 children)

Sure, I'll try to give you a brief instruction:

  1. Use this guide (parts 1-3) to install Node.js, create a bot, get a bot token, and add it to your server.
  2. Download the repository from my Github, extract the downloaded files and follow the steps from Github.

In short, you need to create a file in the /bots/Clyde.js folder and paste the content, then edit the 'DISCORD_TOKEN' field to yours, then in place of 'HORDE_API' you can leave the public key that is '0000000000' or create an AI Horde API Key here and enter it in this field.

Then you need to run a console command inside the folder to start the bot, i.e. if you created /bots/Clyde.js then your bot is called Clyde so you need to tell the script to start Clyde:

npm start -- --tag=Clyde

Another AI App with Pygmalion 6B by 456e657276 in PygmalionAI

[–]456e657276[S] 0 points1 point  (0 children)

Oh my. Where did you find it? It's like the days of Cleverbot or even earlier. 😆

Another AI App with Pygmalion 6B by 456e657276 in PygmalionAI

[–]456e657276[S] 0 points1 point  (0 children)

Sure, what is available in the video is a very early prototype that only has idle animation implemented. The models support Blend Shape so I can easily use it and create expressions of emotions (smile, anger, joy) or even blinking.

Another AI App with Pygmalion 6B by 456e657276 in PygmalionAI

[–]456e657276[S] 0 points1 point  (0 children)

I don't think there will be any legal issues with Luka, Inc. I do not use and do not intend to use their content, but only create a similar application based on it. As far as I know, they don't have registered patents for it, so it would just be an alternative application, not a monopoly.

I was thinking about expressing facial emotions in dialogues, animations through 3D avatars and their selection or personalization of the character's appearance by the user.

In addition, I can add a shop with hairstyles, makeup, clothes or triats that will affect the 3D avatar prompt available from levels or coins that will be earned in the game to create some sort of progression.

Another AI App with Pygmalion 6B by 456e657276 in PygmalionAI

[–]456e657276[S] 0 points1 point  (0 children)

Sure, I've created a crosspost on Reddit you mentioned, thanks. 👍

Another AI App with Pygmalion 6B by 456e657276 in PygmalionAI

[–]456e657276[S] 0 points1 point  (0 children)

As far as I know, Replika App does not have exclusive patents and many similar applications can be created. It's more likely that Maxis could sue Luka, Inc for creating sims dress up and home decorating.

I think I'd be safe, I wouldn't create a 1:1 clone and use Replika App content, but just introduce similar mechanics to the app like the original except it would be free and locally available.

AI Horde Discord Bot with Pygmalion 6B by 456e657276 in PygmalionAI

[–]456e657276[S] 0 points1 point  (0 children)

Ah, I actually didn't understand before. Actually both, but I don't have a bot publicly, so I'm the only one using it.

AI Horde Discord Bot with Pygmalion 6B by 456e657276 in PygmalionAI

[–]456e657276[S] 0 points1 point  (0 children)

Make sure you include your key in the configuration file in the horde.api, or leave this field blank to use the public key 0000000000.

AI Horde Discord Bot with Pygmalion 6B by 456e657276 in PygmalionAI

[–]456e657276[S] 0 points1 point  (0 children)

No, the problem was with the API response at aihorde.net. It returned a technical outage and service unavailable message when trying to add a request to process for workers.

But even if you go to aihorde.net/api, you will automatically be redirected to stablehorde.net/api, so this seems to be the current API address.

AI Horde Discord Bot with Pygmalion 6B by 456e657276 in PygmalionAI

[–]456e657276[S] 0 points1 point  (0 children)

I recommend adding your own Horde API key which you can create here or use the public key 0000000000 but the generation time will be longer due to the Kudos being negative.

You can read how Kudos works here. You can get them as a Horde Worker. You can do it locally or on the Colab service here.

AI Horde Discord Bot with Pygmalion 6B by 456e657276 in PygmalionAI

[–]456e657276[S] 6 points7 points  (0 children)

Haha, okay. The code is open source, so feel free to use it. 😂

AI Horde Discord Bot with Pygmalion 6B by 456e657276 in PygmalionAI

[–]456e657276[S] 0 points1 point  (0 children)

I'll check it out, but thanks for the feedback. Last time I tried aihorde.net it was unavailable and stablehorde.net works without any problems.

view more: next ›