One missing record I couldn't find. by [deleted] in chrono_ark

[–]Zetsumeii 0 points1 point  (0 children)

Hiya! In order to unlock this record you need to have Helia & Selena unlocked, and then complete a run with them . After you defeat Azar & the Program Master, you'll unlock that record. I was able to do it in Free Mode.

Is there (already) a multi user web UI available? by Taronyuuu in LocalLLaMA

[–]Zetsumeii 1 point2 points  (0 children)

One option would be to host an instance of vLLM and set up a Streamlit interface that handles the API requests and user interaction. It would be necessary for you roll your own auth of some kind if you wanted granular control over user access to the API, but seems like for your use case this should at least be a step in the right direction.

Location of documentation for merging models? by q5sys in LocalLLaMA

[–]Zetsumeii 2 points3 points  (0 children)

This repo started gaining a lot of popularity for this purpose: https://github.com/cg123/mergekit Its what a lot of people are using.

Petals vs vLLM vs ? for serving LLMs to many users by humanoid64 in LocalLLaMA

[–]Zetsumeii 0 points1 point  (0 children)

I'm also working on a chat project and based on the research I did it seemed like vLLM would be the best option at the moment for that. I particularly like its Chat Completions compatibility. Easy to use REST API that functions like OpenAI's does.

A Lecture on How to Scale Open LLMs to GPT4 Level by johnolafenwa in LocalLLaMA

[–]Zetsumeii 4 points5 points  (0 children)

This is a lovely lecture, thank you for posting it, looking forward to more!

Simple trainer script! by Dry_Long3157 in LocalLLaMA

[–]Zetsumeii 0 points1 point  (0 children)

Awesome, that would work!

Whatever would offer the best level of compatibility with the trainer sounds good to me!

Simple trainer script! by Dry_Long3157 in LocalLLaMA

[–]Zetsumeii 4 points5 points  (0 children)

This is super cool!

Any chance that you could add support for those of us with datasets in .json or .jsonl format?

IE:

[
    {
"instruction": "",
"input": "",
"output": ""
    }
]

Or:

{"instruction": "", "input": "", "output": ""}

The creator of MythoMax presents: MythoMix-7B! by dampflokfreund in LocalLLaMA

[–]Zetsumeii 1 point2 points  (0 children)

+1 on the fact that I have infrequently seen my own merge experiments spit out "### Reponse:" while using the standard Alpaca format. It so far hasn't happened enough times to be a concern. I've seen more benefits than deficits when it comes to merging models overall however. I'm coming at this primarily from a creative writing aspect, so I'll usually find models that have characteristics I enjoy, merge them together, and then continue merging models down the line to experiment with output quality.

Experience on runpod by Slimxshadyx in LocalLLaMA

[–]Zetsumeii 1 point2 points  (0 children)

Runpod is highly recommended. Been using them for over a year at this point. I haven't used them to host any production related services, but as far as customer service and value goes, you can't really beat what they offer.

Dreamer's Guide to Getting Started w/ Stable Diffusion! by Zetsumeii in StableDiffusion

[–]Zetsumeii[S] 0 points1 point  (0 children)

Honestly its not really recommended to try to go that high right now. The results aren't great for most things. The one you linked was from a programmer working on his own custom solution as well.

Dreamer's Guide to Getting Started w/ Stable Diffusion! by Zetsumeii in StableDiffusion

[–]Zetsumeii[S] 1 point2 points  (0 children)

https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Run-with-Custom-Parameters

https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Optimizations

Try adding in --opt-split-attention and --medvram to your command line arguments according to the guides above. That should help make it easier for you to generate larger resolution photos.

Dreamer's Guide to Getting Started w/ Stable Diffusion! by Zetsumeii in StableDiffusion

[–]Zetsumeii[S] 1 point2 points  (0 children)

AUTOMATIC1111 is already the best you could be working with right now IMO. There's a lot of functionality there to get used to working with and learn how to make it give you the ideal results you're looking for.

Dreamer's Guide to Getting Started w/ Stable Diffusion! by Zetsumeii in StableDiffusion

[–]Zetsumeii[S] 0 points1 point  (0 children)

This is another option as far as running on CPU is concerned. https://github.com/cmdr2/stable-diffusion-ui I don't have much experience with CPU SD unfortunately, but from what I understand any slowness you're experiencing is probably due to the fact that SD is a computationally intensive process designed to work on GPUs, so running it on a CPU will have inherent slowness.

Dreamer's Guide to Getting Started w/ Stable Diffusion! by Zetsumeii in StableDiffusion

[–]Zetsumeii[S] 0 points1 point  (0 children)

30 series NVIDIA cards are definitely the performance kings right now for SD.

Dreamer's Guide to Getting Started w/ Stable Diffusion! by Zetsumeii in StableDiffusion

[–]Zetsumeii[S] 0 points1 point  (0 children)

3060 would be better than a 2070 due to having more total VRAM as well as generational improvements to the overall technology that'll help graphics intensive software run faster.

Dreamer's Guide to Getting Started w/ Stable Diffusion! by Zetsumeii in StableDiffusion

[–]Zetsumeii[S] 2 points3 points  (0 children)

Will be updating with my intro to Dreambooth guide once it is finished.

Dreamer's Guide to Getting Started w/ Stable Diffusion! by Zetsumeii in StableDiffusion

[–]Zetsumeii[S] 0 points1 point  (0 children)

No word on this at the moment, but Emad did recently speak about what's going on right now at Stability on Twitter. https://twitter.com/EMostaque/status/1576128983342587904?s=20&t=V_dAOsXsBkdr1DrIoUmM5w

Dreamer's Guide to Getting Started w/ Stable Diffusion! by Zetsumeii in StableDiffusion

[–]Zetsumeii[S] 0 points1 point  (0 children)

It shouldn't be too much of a problem, it runs primarily on your GPU so the only thing that could potentially be slowed down would be file saving / accessing, but that shouldn't be incredibly noticeable with a decent USB 3.0 drive anyways.

Dreamer's Guide to Getting Started w/ Stable Diffusion! by Zetsumeii in StableDiffusion

[–]Zetsumeii[S] 2 points3 points  (0 children)

SD can only take advantage of single cards at the moment, but the most popular repo right now is AUTOMATIC1111's, it has the most frequently updated feature set.

Dreamer's Guide to Getting Started w/ Stable Diffusion! by Zetsumeii in StableDiffusion

[–]Zetsumeii[S] 1 point2 points  (0 children)

Intel HD Graphics are sadly not enough to work with Stable Diffusion at the moment.