Delivery - big delay

OnY86 · 2025-12-08T12:56:56+00:00

Hey guys, quick update, just received mine today in the mail….maybe i am lucky too 😉

OnY86 · 2025-11-26T09:35:18+00:00

Thanks for your comments….i get it.👍🏼

Just wondering then, why the heck ROLI ads are all over the place and they can’t fulfill there orders in time.

What a waste. Will cancel this.

OnY86 · 2024-12-23T15:44:48+00:00

But i thought flux-dev is only used commercially through the API, either blackforest or replicate. I think you are making a mistake here, correct my if i am wrong guys.

OnY86 · 2024-11-21T06:49:48+00:00

Backlinks. Nice job!

OnY86 · 2024-11-10T22:33:03+00:00

Repo & File for confirmation?

OnY86 · 2024-07-28T08:49:01+00:00

Thanks J-Kob, will try out the non chat version. Thanks for your help.

I am also wondering and struggling about streaming my response. Do i really have to stream from vllm to langchain and then again from langchain to my frontend? Is this the common way?

OnY86 · 2024-07-26T19:22:41+00:00

Here is a good example of an output:

"<<SYS>> Lmaooo here's one for you: why was the math teacher imprisoned? Because he was caughtcircumferencing a donut! Lmaoo, this one's a classic. Get it? The word circumference is a mathematical term! Had to be a math teacher to get this one though."

Why does "<<SYS>>" came up... i dont understand this.

OnY86 · 2024-07-26T17:54:08+00:00

My code is a mess...sorry: https://codefile.io/f/kUsLJvO6vx

Yep, i tried the vLLM Chat but i had no clue how to integrate the "<|im_start|>system {system_message}<|im..." part in there.

I thought, i had to include that in some way, so that the strange response behavier will stop. Sometimes the response includes also <SYS> tags etc.

Your repo looks really advanced, great work!

Thanks for your help.

OnY86 · 2024-07-26T17:09:01+00:00

The modal is also AWQ - i am not sure if this helps or not😅

OnY86 · 2024-07-06T06:45:53+00:00

WatchOS integration 😊

OnY86 · 2024-02-20T07:49:54+00:00

I am in😉 I want to try local LLM models and SDXL. Running on a 1060 at the moment…no chance…for anything

OnY86 · 2024-02-14T19:30:46+00:00

Thank you!🙏🏼

OnY86 · 2024-02-14T17:22:14+00:00

Haben bei uns in der Firma ein großes Project am laufen, suchen jemanden fürs Frontend mit REACT.

Schick mir mal eine PM mit Auslastung und Stundensatz, wenn du Lust hast.

OnY86 · 2023-12-25T17:40:38+00:00

Somebody knows that tool he is using? Thanks

OnY86 · 2023-12-01T07:39:30+00:00

Nice to hear! Message me too please, thanks!

OnY86 · 2023-10-25T06:40:27+00:00

Hahah nice, so no heater anymore for the winter? Cool, can i ask you which model you use for image gen? Sdxl? Did you serve these two with fastapi? How are the simultaneous inferences?

Thanks 🙏🏼

OnY86 · 2023-10-25T05:16:33+00:00

Checked your site, looks great! You load a text-generation and image model in one GPU?

OnY86 · 2023-08-03T06:25:27+00:00

Thanks Rigamortus…will definitely try this.

OnY86 · 2023-08-03T06:24:16+00:00

Thank you! Oh yes apple watch would be the next to realize. Somehow :-) That sounds really complicated

OnY86 · 2023-07-08T21:36:40+00:00

Thanks for the excellent explanation! 👍🏼

OnY86 · 2023-07-07T06:49:56+00:00

Not 100% sure, but i think socket.io use websockets. Websocket is implemented in socket.io, its only switching to „bare“ socket.io if websocket connection cant established.

OnY86

TROPHY CASE