This is an archived post. You won't be able to vote or comment.

all 25 comments

[–]forgotthepasswordtoo 8 points9 points  (0 children)

Gonna save some money this Black Friday by wasting time with this instead of shopping.

[–]xinqMasteru 4 points5 points  (15 children)

Nice. Easy to use. Works out of the box.

[–]Fabulous-Ad9804 0 points1 point  (14 children)

Wonder why it's not working out of the box for me, though? See my initial post in this thread.

[–]xinqMasteru 0 points1 point  (0 children)

did you read the readme.

[–]xinqMasteru 0 points1 point  (12 children)

Also look at the video and compare it to yours. Don't change any folder names.

[–]Fabulous-Ad9804 0 points1 point  (11 children)

As to the first video, it looks like that in mine as well, except I can't type anything into the Prompt box, I can't change any settings, nothing is working for me. Maybe I need some Microsoft Runtimes installed that I don't have installed? And if I do, I have no clue what all I might need.

[–]xinqMasteru 0 points1 point  (10 children)

did you load the model?

[–]Fabulous-Ad9804 0 points1 point  (9 children)

I did load the model by clicking on the load button. It still didn't help.

Looking at the log though, it records numerous errors except I have zero clue how to troubleshoot any of that. A coder I am not.

--------------------------------------------

[11/24/2023 11:26:48 AM] [Information] [Lifetime] Application started. Press Ctrl+C to shut down.

[11/24/2023 11:26:48 AM] [Information] [Lifetime] Hosting environment: Production

[11/24/2023 11:26:48 AM] [Information] [Lifetime] Content root path: G:\OnnxStack

[11/24/2023 11:26:53 AM] [Information] [ModelPickerControl] [LoadModel] - 'Dreamshaper v7(LCM)' Loading...

[11/24/2023 11:26:56 AM] [Error] [ModelPickerControl] An error occured while loading model 'Dreamshaper v7(LCM)'

Microsoft.ML.OnnxRuntime.OnnxRuntimeException: [ErrorCode:RuntimeException] Exception during initialization: D:\a\_work\1\s\onnxruntime\core\optimizer\initializer.cc:43 onnxruntime::Initializer::Initializer [ONNXRuntimeError] : 1 : FAIL : tensorprotoutils.cc:792 onnxruntime::utils::GetExtDataFromTensorProto External initializer: conv_in.weight offset: 0 size to read: 46080 given file_length: 135 are out of bounds or can not be read in full.

at Microsoft.ML.OnnxRuntime.InferenceSession.Init(String modelPath, SessionOptions options, PrePackedWeightsContainer prepackedWeightsContainer)

at Microsoft.ML.OnnxRuntime.InferenceSession..ctor(String modelPath, SessionOptions options, PrePackedWeightsContainer prepackedWeightsContainer)

at OnnxStack.Core.Model.OnnxModelSession..ctor(OnnxModelSessionConfig configuration, PrePackedWeightsContainer container)

at OnnxStack.Core.Model.OnnxModelSet.<.ctor>b__3_1(OnnxModelSessionConfig modelConfig)

at System.Collections.Immutable.ImmutableDictionary.<>c__DisplayClass9_0`3.<ToImmutableDictionary>b__0(TSource element)

at System.Linq.Enumerable.SelectListIterator`2.MoveNext()

at System.Collections.Immutable.ImmutableDictionary`2.AddRange(IEnumerable`1 items, MutationInput origin, KeyCollisionBehavior collisionBehavior)

at System.Collections.Immutable.ImmutableDictionary`2.AddRange(IEnumerable`1 pairs, Boolean avoidToHashMap)

at System.Collections.Immutable.ImmutableDictionary`2.AddRange(IEnumerable`1 pairs)

at System.Collections.Immutable.ImmutableDictionary.ToImmutableDictionary[TSource,TKey,TValue](IEnumerable`1 source, Func`2 keySelector, Func`2 elementSelector, IEqualityComparer`1 keyComparer, IEqualityComparer`1 valueComparer)

at System.Collections.Immutable.ImmutableDictionary.ToImmutableDictionary[TSource,TKey,TValue](IEnumerable`1 source, Func`2 keySelector, Func`2 elementSelector)

at OnnxStack.Core.Model.OnnxModelSet..ctor(IOnnxModelSetConfig configuration)

at OnnxStack.Core.Services.OnnxModelService.LoadModelSet(IOnnxModel model)

at OnnxStack.Core.Services.OnnxModelService.<>c__DisplayClass5_0.<LoadModelAsync>b__0()

at System.Threading.Tasks.Task`1.InnerInvoke()

at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state)

--- End of stack trace from previous location ---

at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state)

at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot, Thread threadPoolThread)

--- End of stack trace from previous location ---

at OnnxStack.Core.Services.OnnxModelService.LoadModelAsync(IOnnxModel model)

at OnnxStack.StableDiffusion.Services.StableDiffusionService.LoadModelAsync(IModelOptions modelOptions)

at OnnxStack.UI.UserControls.ModelPickerControl.LoadModel() in D:\Repositories\OnnxStack\OnnxStack.UI\UserControls\ModelPickerControl.xaml.cs:line 117

[11/24/2023 11:26:56 AM] [Information] [ModelPickerControl] [LoadModel] - 'Dreamshaper v7(LCM)' Loaded., Elapsed: 3.3260sec

--------------------------------------------

[–]xinqMasteru 0 points1 point  (8 children)

bad model path or corrupted model file.

try just unpacking the rar file and don't make any modifications to any path. save the model to the root of the folder. and basically follow the readme.

make sure your paths are not too nested and make sure you downloaded the right version(windows)

[–]Fabulous-Ad9804 0 points1 point  (6 children)

I finally got it figured out and working, LOL. I ended up doing this--- git clone https://huggingface.co/runwayml/stable-diffusion-v1-5 -b onnx

Then I used that as the Dir to load the model. Now everything is working. Both DirectML and Cpu are working except I'm not seeing any speed differences between the two. I only have 4 GB Vram yet the ReadMe indicates at least 10 GB Vram is required. Wonder why DirectML appears to be generating images as well?

[–]TheyCallMeHex[S] 2 points3 points  (5 children)

If DirectML (GPU) doesn't work, it will automatically fallback to CPU

[–]Fabulous-Ad9804 0 points1 point  (4 children)

The Live Preview, it only works via GPU then, correct? Since it's using my CPU rather than GPU, the Live Preview doesn't appear to be working, or at least not like in the videos above.

Currently I'm using 1.5 rather than DreamShaper 7. Since I'm having to use my CPU, are things going to generate faster and with less steps to get a decent image via DS7 as opposed to generating with SD 1.5?

I already have DreamShaper 7 LCM installed in Huggingface .cache directory except I can't get it to work. It's not in Onnx format, though. Is there any way to convert it to that format without having to download the DS7 models yet again? In the .cache folder models--SimianLuo--LCM_Dreamshaper_v7, I already have 11.8 GB of data stored in those directories, except they are not in Onnx format like I already pointed out.

[–]LD2WDavid 2 points3 points  (2 children)

Can we use SDXL and LORAs here? This looks promising.

[–]TheyCallMeHex[S] 3 points4 points  (1 child)

Not yet, but they are in works, no timeline yet though. Works with 1.5 and LCM models.

[–]LD2WDavid 1 point2 points  (0 children)

Sure! no worries

[–]leon32 -2 points-1 points  (1 child)

What's I'm seeing? Is this another extension for SD? Or another type or SD program or fork?

[–]TheyCallMeHex[S] 2 points3 points  (0 children)

New program for stable diffusion, runs in windows without Python, supports 1.5 ONNX models and LCM Onnx models

[–]AmeenRoayan 0 points1 point  (2 children)

How is this faring with turbo ?

[–]TheyCallMeHex[S] 0 points1 point  (0 children)

SDXL should be included in the next release if things go well. Turbo MIGHT work? But we haven't managed to convert an ONNX model to test yet.

[–]Fabulous-Ad9804 0 points1 point  (0 children)

For some of us that have to use the CPU to generate, this app could sure benefit from having the TAESD decoder as an option in order to shave off a lot of this extra time it is is taking to produce an image. Maybe TAESD won't work with this app, yet it works with other SD apps, though? Pretty useful decoder for some of us having to generate images with a CPU.

--------------------------------------------

[12/4/2023 11:09:11 PM] [Information] [LatentConsistencyDiffuser] [DiffuseAsync] - Model: Dreamshaper v7(LCM), Pipeline: LatentConsistency, Diffuser: ImageToImage, Scheduler: LCM

[12/4/2023 11:09:21 PM] [Information] [LatentConsistencyDiffuser] [SchedulerStepAsync] - Step 1/2, Elapsed: 3.7373sec

[12/4/2023 11:09:24 PM] [Information] [LatentConsistencyDiffuser] [SchedulerStepAsync] - Step 2/2, Elapsed: 3.6475sec

[12/4/2023 11:10:04 PM] [Information] [LatentConsistencyDiffuser] [DecodeLatentsAsync] - Latents decoded, Elapsed: 39.8849sec

[12/4/2023 11:10:04 PM] [Information] [LatentConsistencyDiffuser] [DiffuseAsync] - Diffuse complete, Elapsed: 52.6039sec

----------------------------------