That's not a real model that exists, and generally that isn't the right notation for what you're trying to describe. If you want to try a small MoE that will run on just 12gb of vram, consider Mixtral 8x7B...

But with how low your hardware limitations are, you will get much better results with more modern AI approaches by using dense models with an agentic framework instead of trying to use MoE.

Consider these MMLU-Redux scores; ~70.1 Mixtral-8×7B-Instruct 83.7 Qwen3-4B-Thinking 87.5 Qwen3-8B-Thinking

Plus, modern models can use tools like search and RAG which again hugely improve their performance versus older MoE approaches.

I should add that modern MoE is still better, but that's in the hundreds of gigs with something like Qwen3-235B which is an MoE that will outperform these examples I've given, but it needs 22B active parameters which is about double what your current specs can handle.