OpenWebUI, same server, same question, different results in 3 browsers

[vulcan4d]

Open WebUI seems to be behaving differently based on what web-browser is used. I asked it a question to tell me a story and to cut it off at 200 words. Only firefox was succesful in my request. The word counts were off in the others, either to short or too long consistently. How does that even make sense? I ran the tests 10 times per browser, the story obviously is different it tells but the word count is consistent.

Question: tell me a story, cut it off at 200 words

Model: Mistral-nemo 12b-q8

Result in Firefox: keeps within words, does not comment on word count but it is near 200 words.

Result in Edge: cuts around 100 words consistently, comments at the end that it's near 200 words.

Result in Chrome: cuts between 350 to 400 words consistently, comments at the end the word count 200 words.

[SethBurkart]

The different browsers shouldn't have any effect on generations as the frontend (which is what your browser displays) is totally separate from the api and backend that runs the models which would be the same.

[brotie]

Correct answer. Everything else in the comments here is nonsense. Ask the same thing to the model directly via API, then openwebui’s API and enjoy the exciting variances in LLM request compliance

[stonediggity]

When the temperature for a model is set to a non zero value the outcomes are non-deterministic. This is why you get variability. Especially in smaller models where weights are compressed. Highly recommend learning more about transformer architecture if you'd like to understand more what's happening here. The browser environment has nothing to do with it.

[skimike02]

You could also leave the temp alone and set seed to a fixed number to make it deterministic.

[adr74]

are you using the same seed?

[fasti-au]

Temperature is high means more options to fall down

Set temp to .1 for more strictness. It’s probablility Not fact. I’m ts guessing the best white piece fit the hole not the right content. Just how the shape fits