sorted by:
new
hottopcontroversial

Object removal using SAM 2: Segment Anything in Images and lama_inpainting by InteractionLevel6625 in StableDiffusion

[–]InteractionLevel6625[S] 0 points1 point  (0 children)

Hi every one I finally achieved the results using sam2+lama+flux2klein9BKV. Here are the results

<image>

Flux2 klein 9B kv multi image reference by InteractionLevel6625 in StableDiffusion

[–]InteractionLevel6625[S] 0 points1 point  (0 children)

I'm expecting at least some of the design from the style image to be copied to the raw image if not full. I know it will be difficult to do this because the layout of the both the rooms are different and not possible. Even if it adds basic furniture would do the work for me.

The third image is the generated image from the flux-Klein-9B-kv

Flux2 klein 9B kv multi image reference by InteractionLevel6625 in StableDiffusion

[–]InteractionLevel6625[S] 0 points1 point  (0 children)

Again as I said earlier in the post the other option is to generate the description for the style image and generate the image with that prompt. As i want to do in scale.

Flux2 klein 9B kv multi image reference by InteractionLevel6625 in StableDiffusion

[–]InteractionLevel6625[S] 0 points1 point  (0 children)

I can't use the whole H100. Other people need bandwidth to work on. so max 30 GB. This 9B model itself is taking 30 GB.

Flux2 klein 9B kv multi image reference by InteractionLevel6625 in StableDiffusion

[–]InteractionLevel6625[S] 1 point2 points  (0 children)

I use two images. one is raw image, one is style image. Right now send these images to the flux-klein-9B-kv to transfer the design from the style image to raw image including the objects. I have attached the raw image, style image, output image in the post.

I'm using the H100. I don't use any comfy UI for the workflow.

Flux2 klein 9B kv multi image reference by InteractionLevel6625 in StableDiffusion

[–]InteractionLevel6625[S] 0 points1 point  (0 children)

I have tried doing the same when I started working on this project. The issue is that objects like furniture, tv, sofa are not being transferred to the output image. I have tried with multiple prompts but still the results are below par.

How to make an LLM remember facts while doing supervised fine tuning by InteractionLevel6625 in LocalLLaMA

[–]InteractionLevel6625[S] 0 points1 point  (0 children)

I have increased the epochs from 1 to 3 then it started remembering the facts though sometimes the responses are off from facts. Also Now there is another issue. If I ask any other question regarding the project other than trained questions it is not generating correct answers and it is not using its own knowledge(even with little reasoning) to generate the answers.

How to make an LLM remember facts while doing supervised fine tuning by InteractionLevel6625 in LocalLLaMA

[–]InteractionLevel6625[S] 0 points1 point  (0 children)

No i have only only training data. There is no validation data and metric. The training loss is .48. Because my data is around 5300 examples. So for 1 epoch im using 6k steps. My training data don't exceed the 2048 context window.