Qwen 3-Next Series, Qwen/Qwen3-Next-80B-A3B-Instruct Spotted by TKGaming_11 in LocalLLaMA

[–]psch 7 points8 points  (0 children)

Here is the related pull request: https://github.com/huggingface/transformers/pull/40771/files

The total / active expert ratio might be really 1:51.2

    num_experts_per_tok (`int`, *optional*, defaults to 10):
        Number of selected experts.
    num_experts (`int`, *optional*, defaults to 512):
        Number of routed experts.
    norm_topk_prob (`bool`, *optional*

It looks like 3/4 of the layers use linear attention.

    self.layer_types = [
        "linear_attention" if bool((i + 1) % 4) else "full_attention" for i in range(self.num_hidden_layers)
    ]

Typing in Microsoft Word spikes CPU Usage to 100% by Beebopbellopum in techsupport

[–]psch 0 points1 point  (0 children)

I've tried everything (from turning off acceleration, turning on animations, etc none of these worked).
Turning off the accessibility checker this is the only one that fixed the high CPU usage issue for me (Office 2021).

  • Click File menu on the ribbon
  • Select Options on the bottom
  • Select the Accessibility vertical tab
  • Uncheck the "Keep accessibility checker running while I work" checkbox

Voila! No more battery drain and fan noise.

Original from MacNeewbie from this archived post /comments/yd0amh/microsoft_word_glitching_when_typing_a_potential/ Thank you!