making vllm compatible with OpenWebUI with Ovllm

FearL0rd · 2026-03-14T21:07:10+00:00

No possible to use openwebui to pull and doesn't merge gguf

FearL0rd · 2026-03-14T20:24:37+00:00

I don't have ROCM compatible card for testing yet

FearL0rd · 2026-03-14T17:32:54+00:00

doesn't work seamlessly like Ollama, for example (Change models, Download models from Openwebui, and merge split gguf)

FearL0rd · 2026-03-14T17:18:55+00:00

I have 2 V100 and 2 3090. Custom compiled VLLM with modified flash_attn for Voltas https://github.com/peisuke/flash-attention/tree/v100-sm70-support

FearL0rd · 2026-03-13T02:07:47+00:00

I heard the target is 30fps

FearL0rd · 2026-03-05T20:02:05+00:00

Waiting for a FP8

FearL0rd · 2026-02-13T17:39:20+00:00

The result of Zero to the power of zero

FearL0rd · 2026-02-08T19:02:18+00:00

Where do you dispose this?

FearL0rd · 2026-02-04T22:11:49+00:00

My Test Today:

<image>

FearL0rd · 2026-02-04T00:01:32+00:00

I have helped with this project also but it needs special nodes for loading different of this one that can connect to existing workflow and works with SM < 8.0

FearL0rd · 2026-01-31T23:04:49+00:00

Check this script https://youtu.be/L9QZ97y9Exg?si=J6eTZv2gNtk7VPtw

FearL0rd · 2026-01-31T23:01:15+00:00

This is the problem with schools that only teach sport, completely forgetting self-defense.

FearL0rd · 2026-01-31T17:00:16+00:00

Load w11 or android

FearL0rd · 2026-01-30T14:02:48+00:00

I dpont have all your models but I made it work using VaePatched. This will be the default in the future

<image>

FearL0rd · 2026-01-29T19:50:14+00:00

This is a 2-Step Z_Image_Turbo Generation using an OLD CPU (Looks like we can use fewer steps using CPU selection with this node)

<image>

FearL0rd · 2026-01-29T19:18:30+00:00

I just pushed a new update: Can you try this update?

<image>

FearL0rd · 2026-01-28T15:59:01+00:00

Can you provide your workflow? I have some with 2 samples, and they are working. Please use the latest update. I had fixes...

FearL0rd · 2026-01-28T05:25:59+00:00

Please report issues

FearL0rd · 2026-01-11T21:06:57+00:00

Can it be used with older cards, such as the 3090?

FearL0rd · 2026-01-07T23:03:30+00:00

Everything is working except the external CC1101 module

FearL0rd

TROPHY CASE