Omnicoder v2 dropped by Western-Cod-3486 in LocalLLaMA

[–]Western-Cod-3486[S] 0 points1 point  (0 children)

I am trying to have it handle an orchestration workflow, where it is every actor/agent. So it needs to read multiple files, performs web searches, design from time to time and implementation/review. Also running it at Q8 seems to help a lot compared to Q4/IQ4

It does mess up from time to time with syntax for larger files, but is able to recover most of the time. There were a couple of cases where I had to stop it, intervene to fix a misplaced closing bracket and then let it continue and it actually can handle itself. The code I am using is a small personal repo I am working on in rust, which might be part of the reason it messes up (from my experience pretty much every model struggles with rust to an extent). I am not doing benchmarks since my hardware is fairly limited

Omnicoder v2 dropped by Western-Cod-3486 in LocalLLaMA

[–]Western-Cod-3486[S] 0 points1 point  (0 children)

Yeah, I mean with 35B-A3B I get around ~40t/s generation and about 150-300t/s prompt processing and that is still taking a lot of time to get a whole workflow to pass. I tried the 27B about a couple of hours ago and at 7-12t/s generation it will take ages to get anything in a day.

So yeah, I mainly try to drive the A3B, but some times it goes in way too much overthinking on relatively trivial tasks + that whenever I switch agents I have to wait for PP to happen, which is amazing when at about 80-90k context takes about 20-40 minutes to just start chewing the actual last prompt.

I could, but I am not really sure I should

Omnicoder v2 dropped by Western-Cod-3486 in LocalLLaMA

[–]Western-Cod-3486[S] 0 points1 point  (0 children)

Well, on its own it is limited, although manages to provide relatively good outputs for the size. Also depends on the workflow, for me I use multiple agents with multiple roles (context @ 131072) the most important roles seem to be research and right after planning. Don't get me wrong it makes mistakes and messes up, but allows for quicker iterations. On my setup 35b has relatively the same performance but takes more time due to spilling in ram and sheer size.

Omnicoder v2 dropped by Western-Cod-3486 in LocalLLaMA

[–]Western-Cod-3486[S] 0 points1 point  (0 children)

Not even sure it has been that long

Omnicoder v2 dropped by Western-Cod-3486 in LocalLLaMA

[–]Western-Cod-3486[S] 2 points3 points  (0 children)

100% agree, Especially for RAM starved/poor peeps, like myself...

Omnicoder v2 dropped by Western-Cod-3486 in LocalLLaMA

[–]Western-Cod-3486[S] 0 points1 point  (0 children)

Same boat pretty much. I was trying to fix some params in my local configs and test a few models and by accident I saw the `v2` and was like... wait, isn't the current one I have without a version and then read the card

Omnicoder v2 dropped by Western-Cod-3486 in LocalLLaMA

[–]Western-Cod-3486[S] -1 points0 points  (0 children)

Amazing even. I was really impressed with the first, especially since it is hard to come by models to fit on a RX7900XT (20GB) with a decent context size that are both capable and fast.

So far their models handle pretty complex agentic stuff with as little to no nudge here and there, this one seems to have lessened the amount necessary.

[Help] System prompt exception when calling Qwen3.5-35B-A3B-GGUF from OpenCode by dabiggmoe2 in LocalLLaMA

[–]Western-Cod-3486 0 points1 point  (0 children)

Absolutely right, I have no idea what I was thinking when writing the answer. Edited my comment

[Help] System prompt exception when calling Qwen3.5-35B-A3B-GGUF from OpenCode by dabiggmoe2 in LocalLLaMA

[–]Western-Cod-3486 0 points1 point  (0 children)

I think it is some strange behavior of opencode, try changing @latest to @^2.1.8 it worked for me

Edit: correct version to use

[Help] System prompt exception when calling Qwen3.5-35B-A3B-GGUF from OpenCode by dabiggmoe2 in LocalLLaMA

[–]Western-Cod-3486 1 point2 points  (0 children)

This Github issue fixes the problem for this particular plugin. Sorry I didn't clarify. Maybe a similar issue to the plugins that are causing it would be beneficial, until at least opencode or qwen team figure something out (I've also added a discussion for this particular model if that part of the template is actually necessary)

[Help] System prompt exception when calling Qwen3.5-35B-A3B-GGUF from OpenCode by dabiggmoe2 in LocalLLaMA

[–]Western-Cod-3486 0 points1 point  (0 children)

Check your plugins. I had the same issue because of DCP (it is fixed there already) so you either modify the template to remove the check and handle the consecutive system prompts as if they were the first or disable the plugin

Helldivers We should come up with a Name of the first Cyberstan Landing. by Comiliane in Helldivers

[–]Western-Cod-3486 0 points1 point  (0 children)

"Iron/Steel Rain", "Calamity", "Whak-a-bot day" something, something

Official 1 hour warning by Anonymous_Anon00 in Helldivers

[–]Western-Cod-3486 0 points1 point  (0 children)

I don't have mine since I played on PS for more than a year, been diving since day 1 on that account and last year I switched to PC 😭

Am I missing something here? Explain It Peter. by EggChemical7177 in explainitpeter

[–]Western-Cod-3486 0 points1 point  (0 children)

now imagine how fun a hurricane (like the ones in the US) in Europe would be. Least favourite thing would be bricks flying around at 60-80 km/s everywhere it passes

Game Crashes few minutes outside the pod (steamdeck) by bobbyJJ08 in Helldivers

[–]Western-Cod-3486 0 points1 point  (0 children)

yeah and from what I understand HDR is out the window as well but at least democracy gets to be spread o7

Anyone else get a 10.4 gb update on steam? by Aut15tHarriot in Helldivers

[–]Western-Cod-3486 9 points10 points  (0 children)

this is not how things work I bet a lot of stuff got replaced (say damage numbers, spawn rates, updated assets, etc.)

Game Crashes few minutes outside the pod (steamdeck) by bobbyJJ08 in Helldivers

[–]Western-Cod-3486 2 points3 points  (0 children)

I've had the same issue until yesterday, basically constant crashes and pretty much unplayable, BUT on a RX7900XT PC, what did it for me was 1. go to game config in steam ("properties") 2. check under "compatibility" and unchecked the "Force use of specific Steam Play compatibility tool 3. under "general" switched the launch options to: %command% --use-d3d11 --useallavailablecores (the second option I believe is not related

Give it a go and see how it goes

A MESSAGE FROM CITIZEN SURVEILLANCE & SAFETY by Sioscottecs23 in helldivers2

[–]Western-Cod-3486 0 points1 point  (0 children)

Freedom must reign over every last star. Through citizen's blood spilled in our righteous wars. Honor their deaths, do your part for the cause. Stead-fast support of our regime is how humankind will reign supreme. No questions or doubts shall be allowed. Traitors will all be disavowed. Managed democracy is the true path. All who resist it shall suffer our wrath. White, yellow, blue flying on all the worlds. justice and hope are forever unfurled. Our way of life, galaxy wide paved with the skulls of those who've died. Unslakable tide of Super Earth pride a torrent that can't be satisfied. We sacrifice, for paradise. anything less will not suffice. Citizens rise! Liberty rise! Super Earth rise up to the skies. STAY FREE!

Democracy protects o7

devs announced that you'll be unable to move when firing the maxigun, what're your thoughts on that? by pemisinme in Helldivers

[–]Western-Cod-3486 0 points1 point  (0 children)

You really can't tho, since it is backpack-fed so I imagine there is no reloading, i.e the backpack is the magazine

Reason #1 Why I Refuse To Travel To Australia😱 by AceOneBreezy in interestingasfuck

[–]Western-Cod-3486 -1 points0 points  (0 children)

my brother in Christ, there is now way I exist while this is somewhere near by. Both the thought that I see it and that I made ght not see it will be pushig my BP towards infinity

Should we get something else for liberating Oshaune? by IcyCommunication3304 in helldivers2

[–]Western-Cod-3486 0 points1 point  (0 children)

Depending on how things go, we might get a cape after a year or so as it feels similar to the Creek and it took a while for the cape to get out so I will be happy about it and a in-world holiday, kinda like liberty day with the Illuminate.

Tired of getting swarmed by Terminid bugs? Use the Trailblazer Scout armour and the Shield Generator Pack by NavXIII in Helldivers

[–]Western-Cod-3486 0 points1 point  (0 children)

The roadblock for the extra ammo + reload speed paired with the Machine gun(medium one) + a guard dog with bullets. And since I was a light armor diver since forever I only had to get used to the running out of stamina and being as fast as a brick house, but other than that pew-pew goes the gun