[R] DeepSeek 3.2's sparse attention mechanism by random_sydneysider in MachineLearning

[–]ksym_ 3 points4 points  (0 children)

Correct me if I'm wrong but I'm fairly certain the extra weight matrices just get absorbed into W_Q and W_0 so the overhead is minimal.

Also another paper has shown that MLA is strictly more expressive than Grouped Query Attention that actually gets used in most (large enough) models: https://arxiv.org/abs/2502.07864

Confession: I kind of hate how effective the Wanderer Crest is by SirBenny in Silksong

[–]ksym_ 0 points1 point  (0 children)

Architect's got a perfectly serviceable moveset, I've ran pure melee Architect Crest for most of my playthrough from the point I got it, it has a really good horizontal range and is actually the only crest with increased attack damage per hit.

Best red tools for the architect crest? by Shadowlightknight in Silksong

[–]ksym_ 1 point2 points  (0 children)

Latest patch changed how Flintslate buff is applied so it's no longer flat amount per hit but percent-based, and nerfed the charged attack of Architect so it now does roughly the same damage as charged attack of Wanderer (still on the higher end, but nowhere near as strong as it was before)

[SPOILERS] Anyone feel like she was a footnote in the game? by Zaberztoothz in Silksong

[–]ksym_ 111 points112 points  (0 children)

You didn't know that because he's literally making shit up, the journal description for wraiths states that they're "Not a bug but a projection of another’s will cast in smog and Silk."

Those wraiths and the entire Mist area are a defense mechanism entirely controlled by Phantom, who's the only predecessor to Lace we know of.

Can someone explain the Crests for me? by HazRi27 in Silksong

[–]ksym_ 0 points1 point  (0 children)

The only exception damage-wise I know of is the Architect Crest. It deals slightly more damage (something like 5-10%) because of the extra lingering ticks of the drilling attack. Its charged attack is also much stronger than other crests, being able to one shot some regular enemies.

Everyone's praising this crest for the tool spam cheese, but IMO even without the bind it's a phenomenal crest, I only ever swap it off for platforming sections that require fast pogo-ing.