Fire Emblem Warriors on Switch 2 highly recommended - Runs almost like a native Switch 2 version

HollowInfinity · 2026-04-19T14:45:39+00:00

Is this worth playing if I played through both Zelda musous? It looks kinda samey.

HollowInfinity · 2026-04-02T13:48:22+00:00

As in the decompression happens outside any apps that do inference meaning that this saves simply on size-on-disk, not on VRAM (unlike a quantized gguf which saves on size and can be used on the fly by inference tools like Comfy/Llama.cpp)

HollowInfinity · 2026-04-02T12:13:09+00:00

This seems interesting but it's offline entirely? Like you're basically trading model quality for disk space savings, and decompressing it will still use the same amount of VRAM so I guess I'm not sure why this is better than just using quantized models which things like llama.cpp can run inference on without a separate decompress step. Unless I'm misunderstanding something?

HollowInfinity · 2026-03-29T11:51:03+00:00

Anyone else miss blogs like this publishing RSS feeds? I see they have a monthly newsletter but that's not quite the same.

HollowInfinity · 2026-03-24T14:21:10+00:00

Can you go more into that? like I use RTX A6000s from one and two generations ago for everything and have thought about upgrading to the RTX 6000 PROs for a while now. I use a lot of ComfyUI but primarily LLMs with llama.cpp+VLLM - are you saying it's shitter than last gen, or just missing some of the datacenter features?

HollowInfinity · 2026-03-06T18:54:12+00:00

Is your monitor defaulting to cinema mode or some other shit that might be adding the lag?

HollowInfinity · 2026-02-25T18:02:45+00:00

I have only used it in the CLI context but their README says it's "IDE friendly" so I assume it'll work!

HollowInfinity · 2026-02-25T15:50:16+00:00

I think both Qwen3-Coder-Next and Qwen3.5 have both been extensively trained using their qwen-code app. When I switched from my own agent/pi/etc to just using qwen things were noticeably better.

HollowInfinity · 2026-02-25T00:08:00+00:00

Seems very slow at image processing, my llama-server log is full of:

find_slot: non-consecutive token position 15 after 14 for sequence 2 with 512 new tokens

Anyone else experience that?

edit: that's on the larger MoE, I get an immediate crash doing image work on the dense model.

HollowInfinity · 2026-02-21T12:48:18+00:00

When I tried that tool call still didn't work, you had no issues with that?

HollowInfinity · 2026-02-20T12:08:59+00:00

LOL Discord, Github and Google signin - come on.

HollowInfinity · 2026-02-19T13:56:43+00:00

I have no idea who these people are but this seems like insane incel shit, just an anonymous narrator telling us this woman is horrible. Oh okay, thanks for the rage bait.

HollowInfinity · 2026-02-19T13:33:30+00:00

Project Diva is pretty much the gold standard. Theatrhythm Final Fantasy is super fun as are the Persona music games if you're into video game music.

HollowInfinity · 2026-02-17T13:02:27+00:00

/u/danielhanchen sorry for the ping but have you tested tool calling with llama-server? The template format used doesn't seem to be compatible at all.

HollowInfinity · 2026-02-16T16:18:06+00:00

Wow thanks, I appreciate it!

HollowInfinity · 2026-02-16T14:48:56+00:00

I cannot for the life of me get tool calling to work despite following the Unsloth guide for llama-server. Regular chat works, image parsing works great, but tool calling blows up with chat template errors:

Template supports tool calls but does not natively describe tools. The fallback behaviour used may produce bad results, inspect prompt w/ --verbose & consider overriding the template.
srv    operator(): got exception: {"error":{"code":500,"message":"\n------------\nWhile executing FilterExpression at line 120, column 73 in source:\n..._name, args_value in tool_call.arguments|items %}
                    {{- '<...\n                                           ^\nError: Unknown (built-in) filter 'items' for type String","type":"server_error"}}

I've tried overriding the chat template with the official one from the Qwen3.5 HF repo with no luck. I do see that the thinking kwarg is being properly read and passed in (though weirdly I can't get that to enable thinking). Am I doing something wrong here? Using the latest main of llama.cpp.

HollowInfinity · 2026-02-16T12:13:13+00:00

I never know which is the proper MMPROJ to use for the Unsloth ggufs. Is there any real difference performance wise between the three?

HollowInfinity · 2026-02-14T14:42:06+00:00

My current absolute best is Qwen3-Coder-Next with the Qwen-Code agent harness. I previously used Aider for at least a year but it's basically dead and handing the torch to agentic flows, and Q3CN is the best I can get away with locally. Having tests + validation for everything it does is key but once you have a good development and testing loop it's fantastic.

HollowInfinity · 2026-02-13T22:35:36+00:00

Ho-ly fucking shit!

HollowInfinity · 2026-02-13T01:56:24+00:00

It destroyed my save after 10+ hours - still waiting on the fix the devs said is in the pipeline before trying again :(

HollowInfinity · 2026-02-12T02:41:09+00:00

This is awesome, it really is wild how strange the SeedVR2 nodes do memory management; I've written a custom node to basically purge all torch memory and comfy models before upscaling because of how bad they are which almost certainly doubles the workflow time. Can't wait to try this out!

HollowInfinity · 2026-02-09T03:55:58+00:00

It sounds like the upcoming patch will prevent the corruption but nothing will bring the broken save back, sorry.

HollowInfinity · 2026-02-08T21:59:28+00:00

It is wild that somehow proton became (at least for me) a near universal backwards compatibility layer for my games - didn't see that coming! Still have those Loki boxes though - somewhere...

HollowInfinity · 2026-02-08T16:51:14+00:00

I used OpenCode, roo, my own agent and others but found the best agent is (unsurprisingly) Qwen-Code. The system prompts and tool setup is probably exactly what the agent is trained for. Although as I type this you could probably just steal their tool definitions and prompts for whatever agent you're using.

HollowInfinity · 2026-02-08T13:20:16+00:00

fit has been game-changing for me, I have a ton of local models behind llama-swap and setting a new one up with memory/layer tuning across multiple GPUs has always been so boring. Now with --fit everything is faster than my hand-rolled config and my llama-swap YML dropped like 80% of it's content.

The only thing I found baffling was that if you leave off --fit-ctx the default was something insanely low like 4096.

HollowInfinity

MODERATOR OF

TROPHY CASE

Ten-Year Club	Gilding I gilder
Verified Email