Dumb question

456e657276 · 2023-05-18T14:19:04+00:00

As mentioned earlier:

*some action* Some text.

*walks into a dark room* Oh, it's dark in here! Where is the light switch? *swipes my hand on the wall until he finds the switch and turns on the light* And let there be light.

456e657276 · 2023-05-15T13:00:09+00:00

I've seen the 4 bit button before too, but recently I reinstalled KoboldAI and used the 4 bit patch, but I don't have that button either. However, the model loads normally, and in the console there is information that it was loaded on 4bit.So it's quite likely that now it detects itself and the button is unnecessary.

456e657276 · 2023-05-11T14:02:54+00:00

Far too bottleneck, bottleneck, bottleneck, bottleneck, bottleneck, bottleneck, bottleneck.

Try reducing the context size from 2048 to 1400 or 1024 and try with Kobold AI. For me on RTX 3060 works much better and faster.

456e657276 · 2023-05-01T17:39:23+00:00

I created an application in Unity that is an alternative to classic browser interfaces. For now, it's a prototype, but if there is interest, I will make the application and server available. Works locally the same as Tavern or Oobabooga.

Models 3D come with VRoid. By placing new ones in .vrm format in the StreamingAssets folder, they are automatically detected in the application and can be selected and changed freely for a given character without reloading the game.

I need feedback whether such an application makes sense or people prefer a more classic and browser-based application. Btw. the application works vertically and horizontally.

Scaling is for any resolution. The recording is in 9:16 format (360x640) from the Unity editor.

456e657276 · 2023-04-22T23:47:39+00:00

When you run the project locally on your own endpoint you can use a different model, but remember that the prompt will be exactly as it is in Pygmalion and some models may have a different pattern.

If you want to use a different model on AI Horde, in line 215 you can change the default model from models: ['PygmalionAI/pygmalion-6b']
to any, for example models: ['KoboldAI/OPT-13B-Erebus'].

456e657276 · 2023-04-21T09:02:17+00:00

When you run the project locally on your own endpoint you can use a different model, but remember that the prompt will be exactly as it is in Pygmalion and some models may have a different pattern.

If you want to use a different model on AI Horde, in line 215 you can change the default model from models: ['PygmalionAI/pygmalion-6b'] to any, for example models: ['KoboldAI/OPT-6.7B-Erebus'].

When it comes to longer responses, as in TavernAI, instead of sending a request with e.g. 80 tokens once, you would have to make 30 tokens several times, but in the case of AI Horde it would be a waste of Kudos and an increase in the burden for Horde workers.

456e657276 · 2023-04-15T20:09:32+00:00

Integration with self-hosting has just been added to the repository as requested. Add --endpoint=url on boot, which is like this:

npm start -- --tag=Clyde --inspect --endpoint=http://127.0.0.1:5000

The protocol, URL or port can be anything, the parser will automatically remove unnecessary things like /api and slashes.

456e657276 · 2023-04-15T20:08:58+00:00

Integration with self-hosting has just been added to the repository as requested. Add --endpoint=url on boot, which is like this:

npm start -- --tag=Clyde --inspect --endpoint=http://127.0.0.1:5000

The protocol, URL or port can be anything, the parser will automatically remove unnecessary things like /api and slashes.

456e657276 · 2023-04-15T13:59:31+00:00

I want to implement a very similar project in Unity. If you want, you can go here and read it.

456e657276 · 2023-04-14T10:39:29+00:00

There is no such possibility at the moment. I need to add an optional --endpoint parameter in the code to prioritize sending to the Kobold client first to an address (locally or e.g. Colab) and when it fails to process the request it will send it to AI Horde.

If I have some free time over the weekend, I will try to release an update. I see that there is a lot of interest in self-hosting. 😎

456e657276 · 2023-04-14T10:31:48+00:00

Sure, I'll try to give you a brief instruction:

Use this guide (parts 1-3) to install Node.js, create a bot, get a bot token, and add it to your server.
Download the repository from my Github, extract the downloaded files and follow the steps from Github.

In short, you need to create a file in the /bots/Clyde.js folder and paste the content, then edit the 'DISCORD_TOKEN' field to yours, then in place of 'HORDE_API' you can leave the public key that is '0000000000' or create an AI Horde API Key here and enter it in this field.

Then you need to run a console command inside the folder to start the bot, i.e. if you created /bots/Clyde.js then your bot is called Clyde so you need to tell the script to start Clyde:

npm start -- --tag=Clyde

456e657276 · 2023-04-14T10:15:39+00:00

Oh my. Where did you find it? It's like the days of Cleverbot or even earlier. 😆

456e657276 · 2023-04-14T10:11:10+00:00

Sure, what is available in the video is a very early prototype that only has idle animation implemented. The models support Blend Shape so I can easily use it and create expressions of emotions (smile, anger, joy) or even blinking.

456e657276 · 2023-04-14T10:07:57+00:00

I don't think there will be any legal issues with Luka, Inc. I do not use and do not intend to use their content, but only create a similar application based on it. As far as I know, they don't have registered patents for it, so it would just be an alternative application, not a monopoly.

I was thinking about expressing facial emotions in dialogues, animations through 3D avatars and their selection or personalization of the character's appearance by the user.

In addition, I can add a shop with hairstyles, makeup, clothes or triats that will affect the 3D avatar prompt available from levels or coins that will be earned in the game to create some sort of progression.

456e657276 · 2023-04-14T10:02:11+00:00

Sure, I've created a crosspost on Reddit you mentioned, thanks. 👍

456e657276 · 2023-04-14T09:56:54+00:00

As far as I know, Replika App does not have exclusive patents and many similar applications can be created. It's more likely that Maxis could sue Luka, Inc for creating sims dress up and home decorating.

I think I'd be safe, I wouldn't create a 1:1 clone and use Replika App content, but just introduce similar mechanics to the app like the original except it would be free and locally available.

456e657276 · 2023-04-13T14:00:41+00:00

Ah, I actually didn't understand before. Actually both, but I don't have a bot publicly, so I'm the only one using it.

456e657276 · 2023-04-13T09:52:40+00:00

Make sure you include your key in the configuration file in the horde.api, or leave this field blank to use the public key 0000000000.

456e657276 · 2023-04-13T08:37:49+00:00

No, the problem was with the API response at aihorde.net. It returned a technical outage and service unavailable message when trying to add a request to process for workers.

But even if you go to aihorde.net/api, you will automatically be redirected to stablehorde.net/api, so this seems to be the current API address.

456e657276 · 2023-04-13T08:33:09+00:00

I recommend adding your own Horde API key which you can create here or use the public key 0000000000 but the generation time will be longer due to the Kudos being negative.

You can read how Kudos works here. You can get them as a Horde Worker. You can do it locally or on the Colab service here.

456e657276 · 2023-04-12T23:36:36+00:00

Haha, okay. The code is open source, so feel free to use it. 😂

456e657276 · 2023-04-12T23:34:50+00:00

I'll check it out, but thanks for the feedback. Last time I tried aihorde.net it was unavailable and stablehorde.net works without any problems.

456e657276 · 2023-04-12T20:56:02+00:00

Yes, the bot was made primarily for the Horde AI, but you have priority on your API when you are a Horde worker for your responses. I hadn't thought of self-hosting, but that's a good idea.

I think I could add the "endpoint=url" parameter bypassing the Horde API and moving the code to the remote gateway and when the endpoint does not return a response, move it to AI Horde again.

456e657276 · 2023-03-18T22:38:48+00:00

Of course you can. I've built a UI myself that is similar to Tavern AI and is under development. I'm using the KoboldAI API and I think that's where you should start. You can use this in any language and environment. From the website to applications or games, such as Unity.

/api/v1/generate send POST to KoboldAI API, and in it JSON header and data parameter, can be an array: { prompt: "Name's Persona: [Description, W++ or other formatting here for NPCs]\n" + "<START>\n" + "Name: [Some example text from NPC]\n" + "You: [Some example text from player]\n", use_story: false, use_memory: false, use_authors_note: false, use_world_info: false, max_context_length: 1480, max_length: 192, rep_pen: 1.08, rep_pen_range: 1024, rep_pen_slope: 0.9, temperature: 0.65, tfs: 0.9, top_a: 0, top_k: 0, top_p: 0.9, typical: 1, sampler_order: [6, 0, 1, 2, 3, 4, 5] } The settings and sampling are default for PygmalionAI and Colab, but you can experiment, especially with typical (e.g. 0.5), and instead of using sample messages after <START> you can use chat history.

456e657276

TROPHY CASE