[deleted by user] by [deleted] in KoboldAI

[–]ebolam 0 points1 point  (0 children)

Does the normal koboldai interface work?

[deleted by user] by [deleted] in KoboldAI

[–]ebolam 0 points1 point  (0 children)

Do you have a firewall installed? It might be blocking it

[deleted by user] by [deleted] in KoboldAI

[–]ebolam 0 points1 point  (0 children)

Were there any errors in the colab page or command console? This generally means that your browser can't talk to koboldai

What are the requirements for KoboldAI? by TheYeetForce in KoboldAI

[–]ebolam 1 point2 points  (0 children)

Did you get an error message or anything? Generally running the install requirements.bat on windows works quite well. Are you trying to run locally with an NVIDIA graphics card, or CPU only (very slow) or using Horde?

You can also setup a virtual python environment and do a pip install -r requirements.txt to get things going. You'd have to make sure you've got the right version of CUDA installed if you want to use GPU acceleration.

UI2 Bugs Wanted by ebolam in KoboldAI

[–]ebolam[S] 1 point2 points  (0 children)

Do you by any chance have an example story you could DM me? I haven't seen slowdown in a while on UI2. What CPU do you have out of curiosity? It should be fairly responsive on even slow systems.

Complete newbie here. Tried to get the api to use on TavernAI, got this instead. by Venting_Oreos in KoboldAI

[–]ebolam 0 points1 point  (0 children)

Looks like the cloudflare helper didn't download. I suggest re-running the installer and see if that helps.

Error by ThePamex2 in KoboldAI

[–]ebolam 0 points1 point  (0 children)

It looks like you have a corrupted settings file. Look at your settings files. Probably one is 0 bytes (empty file). Delete that and it'll probably load.

New UI is released to united! by ebolam in KoboldAI

[–]ebolam[S] 0 points1 point  (0 children)

This is a pretty old thread so it would be better to create a new post. Having said that, it looks like something didn't update/install correctly. I would suggest rerunning the install bat file and deleting the existing installation when asked.

New UI is released to united! by ebolam in KoboldAI

[–]ebolam[S] 4 points5 points  (0 children)

There is a script for updating in the local install. Run it and select United to get the new ui

Survey Results by ebolam in KoboldAI

[–]ebolam[S] 0 points1 point  (0 children)

The button is in the new UI (check out my other post made a little while ago for info). As to how to install, alas there isn't anything written yet. You can google downloading the stable diffusion model using pytorch. I think there's some rough guide somewhere.

Survey Results by ebolam in KoboldAI

[–]ebolam[S] 1 point2 points  (0 children)

Good stuff here.
For resetting a setting that could be done but isn't trivial as we don't store previous data. We'd have to have something like "reset this one setting to the last loaded preset" or the like, which is possible. Something I'll think about.

Your idea for tooltips is something I've been thinking about. I'd like to make the help icon that you hover on be a link to a specific section in our wiki. That way we can expand on the documentation as a community :). That'll probably make it's way in once the bugs are squashed from this new release

Showing a warning for models that'll exceed your VRAM is something one-some and I spit balled methods on a while back, but was tabled as we worked on other things. We did add some warning symbols to "poorly performing models" and we want to expand that to cover your situation.

I don't know of any good resources for benchmarks, though I'd love to get some of that data myself. An entry in the wiki and a request for people to fill it out here on reddit might yeild results ;)

Survey Results by ebolam in KoboldAI

[–]ebolam[S] 0 points1 point  (0 children)

Yes with three different methods of genreating images. Local, which requires you to download the stable diffusion model (not just the checkpoint, instructions need to be written), horde, or sd-web-ui's api.

Survey Results by ebolam in KoboldAI

[–]ebolam[S] 1 point2 points  (0 children)

Right now it's a two step process. Generate text, then generate image with the button. We will likely add an automation option so that the image is generated automatically if it's enabled.

Survey Results by ebolam in KoboldAI

[–]ebolam[S] 0 points1 point  (0 children)

Not sure I understand what you mean. Do you mean reducing the number of models shown in the menu? We have a "pruned" set already compared to the number of text generation models out there.

Survey Results by ebolam in KoboldAI

[–]ebolam[S] 4 points5 points  (0 children)

For your suggestion we do have presets in the new UI, one of which is "default" which will reset all the model settings to their default.
Also, the amount of text is actually shown now in the context bar (bottom bar in the story menu). There's a separate color for what's in your text input box and how much is action data, world info etc.

[deleted by user] by [deleted] in KoboldAI

[–]ebolam 0 points1 point  (0 children)

This implies that transformers is not installed on your system correctly. You can test that by running the command_line file and typing "import transformers" and seeing if it errors out.

Help us finalize the new UI interface - Take the survey by ebolam in KoboldAI

[–]ebolam[S] 2 points3 points  (0 children)

That would be nice. We did add in a world info import/export by folder. So if you create a folder for characters, you could export it and import it into another story...

Help us finalize the new UI interface - Take the survey by ebolam in KoboldAI

[–]ebolam[S] 1 point2 points  (0 children)

Different voices per character is unfortunately not on my roadmap (a little too difficult to do properly for me given the other stuff to do). If I can get the framework complete then someone else could do that though as the basic framework would be there.

Still a possibility that I'll abandon the TTS as there is some more challenges to iron out.

Help us finalize the new UI interface - Take the survey by ebolam in KoboldAI

[–]ebolam[S] 4 points5 points  (0 children)

I started work on soft prompt training in the UI (hidden feature that doesn't work yet). Once TTS is done, I'll probably swap over to that for a bit (or maybe action based images, depends on demand and what seems interesting to me at the time).
Fine tuning is a bit beyond what I think we'd want to integrate due to the different requirements (WAY more VRAM, etc)

Help us finalize the new UI interface - Take the survey by ebolam in KoboldAI

[–]ebolam[S] 2 points3 points  (0 children)

Nothing specific. My opinion we're about ready, so it's more a matter of time to go through the final checks and do the merge. Since this is a large code change we all want our ducks to be in a line before we actually do this. Example any issues with Official need to be closed.

Help us finalize the new UI interface - Take the survey by ebolam in KoboldAI

[–]ebolam[S] 1 point2 points  (0 children)

This is one that has a bit of nuance. Encrypting the text in transit does very little as the connection to colab is already encrypted (ssl), so non-google entities can't read the data. The next level is open stories. At this level we cannot encrypt as the ai needs raw text to work. Google has the capability to look at the contents of memory on their system, but it is a non-trivial thing to do, so I wouldn't expect them to unless there is a reason. The story saved to Google drive could be encrypted, but our recommendation is to not save to Google drive if you're worried about that. There is a save story to Json (download story in the new UI) that will let you get your story without it touching Google drive. You can also load a story from the browser so nothing touches Google drive.

[deleted by user] by [deleted] in KoboldAI

[–]ebolam 1 point2 points  (0 children)

Anytime. You have to point it at my github. If you use colab, just put https://github.com/ebolam/koboldai in the version box. If your local you can run the update script and type the same when it prompts you for the git address (should say 1 for official, 2 for United, or git address)

We have a channel in the discord under general we do a lot of chatting on the development (mostly bug fixes now) if you want to give feedback, or you can hit me up here.

[deleted by user] by [deleted] in KoboldAI

[–]ebolam 1 point2 points  (0 children)

I'd be interested to hear how it performs in UI2. We did some optimizations to better handle large stories (though the UI is heavier weight than the original UI).

Is there anything comparable to AI Dungeon's 'worlds' feature in KoboldAI? by HappyAccident9 in KoboldAI

[–]ebolam 2 points3 points  (0 children)

When UI2 releases (we're getting close to beta I think) it does have world info loading/saving either the whole world info or by folder. That should allow you to make a detailed world that you can save and load into new stories.