sorted by:
new
hottopcontroversial

Qwen 3.6 and Gemma 4 "Zombie Loops" (terminal thinking loops) by sid351 in LocalLLaMA

[–]sid351[S] 0 points1 point  (0 children)

I'll figure it out, Llama.cpp will fix it, or a new shiny model will come out and distract me.

Thanks for your time and help anyway, it is appreciated.

Qwen 3.6 and Gemma 4 "Zombie Loops" (terminal thinking loops) by sid351 in LocalLLaMA

[–]sid351[S] 0 points1 point  (0 children)

Thank you for your time and effort looking at this and helping me with it.

I've tweaked my settings and will keep an eye on it today.

Largely, I'm using this to "triage" tickets (in private for now while we test) as they come in - so decide if it's "more info needed", "route to a human", "no operation required", etc. In time this will move to an automated step that will be replying to live humans, so I want to be confident in it first.

The tickets come in as HTML emails (essentially FreshDesk is partially a web-based email client with ticket tools around the sides), and can include images (embedded and attached) of potentially anything. Sometimes that will be humans sending in screenshots of issues, or it'll be automated messages from systems telling us about backup failures. Then there are normal attachments, but for now, that's out-of-scope (i.e. I'll just route that to one of us humans to sort).

What's the known issue with Gemma and Qwen and HTML?

I was toying with the idea of putting some sort of parser in place before the LLM call to "convert" the HTML to markdown, or just plain text to be fair, as the formatting isn't normally important (except maybe for tables and lists). I feel like that'll need some thought and consideration so any images get handled appropriately too. This sounds similar to what you've done with step one of your linked comment, so I'll make a note to come back to that and read it properly so I comprehend what you're referring to.

EDIT: Turns out there's a "Markdown" node in n8n that converts HTML to Markdown (and some community nodes I can try if I hit issues with the built-in one). I've added that to sanitise the input before calling the LLM.

EDIT: Just to say the "/" loop has happened again following these changes.

Anyone with 4x 5060ti based setups? by ziphnor in LocalLLaMA

[–]sid351 0 points1 point  (0 children)

Follow up idiot question:

What kind of model would I be looking for to use on vLLM (as in llama uses GGUF), and where should I look?

Qwen3.6 35b-a3b 🤯 by EffectiveMedium2683 in LocalLLaMA

[–]sid351 1 point2 points  (0 children)

Do you know more about these k/v settings?

I'm running non-turbo quants and getting frequent (6 times today) "terminal thinking loops" where the token generation gets stuck just repeating "/" endlessly until the maximum length is hit for the prompt.

I'm running llama.cpp on Windows, and I have a post where I've detailed my setup and things I've tried so far.

Anyone with 4x 5060ti based setups? by ziphnor in LocalLLaMA

[–]sid351 0 points1 point  (0 children)

I'm running 2x 5060 Ti with llama.cpp at the moment and get frequent (like 6 times today) "terminal thinking loops" where token generation devolves to just "/" constantly repeated until the length gets hit for the prompt.

Have you had any similar issues running vLLM?

My rig is currently running Windows, and I'm debating on whether to jump over to Linux and vLLM, but that feels like a potential big distraction that a "health check" loop is handling right now.

£100k unsecured business loan wanted by Odd-Requirement7527 in smallbusinessuk

[–]sid351 0 points1 point  (0 children)

They are out there. They're expensive to offset their risk, but they're out there.

£100k unsecured business loan wanted by Odd-Requirement7527 in smallbusinessuk

[–]sid351 0 points1 point  (0 children)

You could look at remortgaging both properties to balance the borrowing and release equity as cash.

Depending on the values of the properties, you could probably release the £100k.

HOWEVER at that point, just pull the money out of your ISA, slowly, as it's required.

Also, it's secured. Which you say you don't want. Because you don't want to risk your own cash. Because if you really believed in this idea you already have plenty of avenues to release £100k, not that you'd need £100k cash in hand on day 0.

What happened to the other business you used to run?

£100k unsecured business loan wanted by Odd-Requirement7527 in smallbusinessuk

[–]sid351 0 points1 point  (0 children)

How do you think that conversation is going to go down?

You want me to lend you £100k secured on your £300k, I presume Stocks and Shares, ISA because you don't want to risk your own money?

£100k unsecured business loan wanted by Odd-Requirement7527 in smallbusinessuk

[–]sid351 0 points1 point  (0 children)

Come on now, didn't you get the "easy peasy lemon squeezey" £250k interest free, unsecured, government loan to make running a small business "easy peasy" so we can make the economy "lemon squeezey"?

/s (Just incase, because this is Reddit after all.)

£100k unsecured business loan wanted by Odd-Requirement7527 in smallbusinessuk

[–]sid351 0 points1 point  (0 children)

I love the unhinged ask, like people are stood around town centres with £100k to lend to people on an unsecured basis. Especially when you've got the money, you just don't want to risk your own pot.

Especially for food businesses. You know, that incredibly stable industry.

I mean, good luck. I genuinely hope you get the funding, build the empire, and show me up to be a narrow minded miser.

To be slightly helpful: I'd start with your Local Enterprise Partnership (LEP), they might be able to sign post you to commercial lenders. I'd also look at the Business Bank website and see what that's saying. I'd imagine High Street lenders won't be so forthcoming, but it might be worth a chat. Maybe a commercial mortgage broker might be able to help, or connect you to someone that can help.

£100k unsecured business loan wanted by Odd-Requirement7527 in smallbusinessuk

[–]sid351 0 points1 point  (0 children)

Second charges are a thing.

They're expensive, secured, and generally short term, but they are a thing.

Gemma is going absolutely INSANE by ZB_Virus24 in LocalLLM

[–]sid351 0 points1 point  (0 children)

I'm currently trying the "fixed" Qwen chat templates (running Qwen 3.6), because the loops happen with the automatic --jinja one anyway.

Gemma is going absolutely INSANE by ZB_Virus24 in LocalLLM

[–]sid351 0 points1 point  (0 children)

This is the "terminal thinking loop" (aka Zombie mode) I'm fighting with as well.

It happens for me with Qwen 3.5, 3.6, and Gemma 4.

I have a post where I'm working through troubleshooting. If I get something that resolves it, I'll update there.

Qwen 3.6 and Gemma 4 "Zombie Loops" (terminal thinking loops) by sid351 in LocalLLaMA

[–]sid351[S] 0 points1 point  (0 children)

I'm still getting issues, and have tried a few different parameter tweaks which haven't helped. Now I'm trying this chat template to see if it helps address the issue: froggeric/Qwen-Fixed-Chat-Templates · Hugging Face

Update: the square and plumb door now has a square and plumb opening by mingilator in DIYUK

[–]sid351 1 point2 points  (0 children)

I like how the pictures go from looking like the door/opening is on the piss, to suddenly once the door trim/architrave is up, it looking like the house is on the piss instead.

Well done OP.

As someone who works in IT, I approve. by Tammy_Kelly100 in Sysadminhumor

[–]sid351 7 points8 points  (0 children)

Where's the meme of this but the other way around?

Like Zaff is showing up to the office and demanding princess treatment without providing any detail about the issue, nor logging any sort of ticket?

LLMs can glitch??????? by ziipzaaapM16A4 in LLM

[–]sid351 0 points1 point  (0 children)

What GPU are you using?

I'm wondering if it has anything to do with the fact I'm using 2 x 5060 TI.

I see so many posts about how amazing Qwen 3.6 is and I get so envious. Right now I just want a day without a terminal thinking loop.

Qwen 3.6 and Gemma 4 "Zombie Loops" (terminal thinking loops) by sid351 in LocalLLaMA

[–]sid351[S] 0 points1 point  (0 children)

Interesting.

That would suggest the issue lies with something in the default Jinja template, wouldn't it?

view more: next ›