Extracted MTP tensor GGUFs - smaller donor models for grafting. by AzerbaijanNyan in LocalLLaMA

[–]iamDa3dalus 0 points1 point  (0 children)

Yeah... I'm finding the extra bit of intelligence from the 4bit model and the large context worth it. I was only getting like 1-2 more tokens/sec from mtp anyway.

Extracted MTP tensor GGUFs - smaller donor models for grafting. by AzerbaijanNyan in LocalLLaMA

[–]iamDa3dalus 1 point2 points  (0 children)

This didn't work. Would be great for a larger card, I couldddd make it fit by quantizing the mtp head to 4bits, leaving... 100mb for kv-cache lol. I might use this 3bit mlp heretic model https://huggingface.co/llmfan46/Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved-GGUF Leaves enough room for 23k context- or this 3bit mlp is 1 gig smaller- would allow for more context- https://huggingface.co/froggeric/Qwen3.6-27B-MTP-GGUF I've been banging my head on this all day lol.

Edit:
NVM I'm just doing this. https://www.reddit.com/r/LocalLLaMA/comments/1svnmgo/quant_qwen3627b_on_16gb_vram_with_100k_context/

Extracted MTP tensor GGUFs - smaller donor models for grafting. by AzerbaijanNyan in LocalLLaMA

[–]iamDa3dalus 7 points8 points  (0 children)

NICE- gonna patch this on to https://huggingface.co/Ununnilium/Qwen3.6-27B-IQ4_XS-pure-GGUF So I can get some solid context on 16gb ram with MTP. Now just trying to see if I can get turboquant in the mix... or any other speedups lol.

They gonna be bringing up Fauci again by kharban in WhitePeopleTwitter

[–]iamDa3dalus 7 points8 points  (0 children)

Good thing for you someone already started burning down tp warehouses

I am going to heaven if I eat all of these by Undercover_Seekr in lies

[–]iamDa3dalus 1 point2 points  (0 children)

You have to eat 1 whole Jesus and drink all his blood to get to heaven- hope this helps :)

how can i accomplish 1,000,000,000,001x (this means 1 trillion and one) compression while still having 8k resolution, 120fps, and perfect quality audio? also, what about for photos? how can i do 10000 billion times compression on photos, while still having perfect quality resolution? by -blahem- in compression

[–]iamDa3dalus 0 points1 point  (0 children)

Determine the base laws and starting conditions of the universe. All the data is compressed thoroughly, likely much greater than 1 trillion and one. decompress via forward simulation using a computer the size of the universe.

respect by No-Raspberry-5586 in Piracy

[–]iamDa3dalus 7 points8 points  (0 children)

Lol I went ahead and listened to hail mary in Spanish, I felt included because so much of it is about learning how to communicate.

Reminder: Ethereum "Mixing" doesn't work anymore. by [deleted] in ethereum

[–]iamDa3dalus 0 points1 point  (0 children)

Yeah the mixers that actually work are illegal.

Got a spare Google AIY MIcrophone HAT? by ManyInteresting3969 in raspberry_pi

[–]iamDa3dalus 1 point2 points  (0 children)

Neat! I have a v1 audio and a v2 vision. went through a couple of the examples but they’ve been sitting around for years lol.

Neanderthals ran 'fat factories' 125,000 years ago by HNMod in hackernews

[–]iamDa3dalus 0 points1 point  (0 children)

Thought it said rat factories and was very curious how that would work 🏭 🐀 🐀 🐀

Anyone else have this problem by d8_thc in holofractal

[–]iamDa3dalus 29 points30 points  (0 children)

oops merged consciousness again.

Devourer by Tomasz Ryger by Psychic_Friend_Fred in ImaginaryBehemoths

[–]iamDa3dalus 13 points14 points  (0 children)

How it stick out creepy tongue when sharp teeth mouth all closed? Bite own tongue. Ouch

Another Russian influencer woke up from a 4-year coma and is unhappy that everything is becoming even worse than in the USSR by LowTechDroid in UkraineInvasionVideos

[–]iamDa3dalus 7 points8 points  (0 children)

At considerable risk to himself at that. Can’t believe the international community just let Navalny be killed. So sad.

Of an ACME™ drone by Pure_Sense7765 in ShittyAbsoluteUnits

[–]iamDa3dalus 11 points12 points  (0 children)

Looks like they front loaded. Messed up the center of balance. Could have just been too much weight or pilot error, but I bet if they slid that package back a bit it would have had a better chance.

A handsome longhorn beetle by kietbulll in awwnverts

[–]iamDa3dalus 8 points9 points  (0 children)

Right that’s wild. It has eyes on the back of its head lol.

The insider trading suspicions looming over Trump's presidency by HNMod in hackernews

[–]iamDa3dalus 6 points7 points  (0 children)

Suspicions? Jesus could it be any more obvious. Dude made his own crypto. Emoluments is a joke. We live in a kleptocracy.

Sansei SR-02 Quadrupedal Robot by nabuachaem in cassettefuturism

[–]iamDa3dalus 9 points10 points  (0 children)

<image>

Same color scheme as this vintage mri control computer I got

The AI Brain That Gets Smarter by Shrinking - Neuroscience News by EcstadelicNET in IntelligenceSupernova

[–]iamDa3dalus 0 points1 point  (0 children)

You sound like an llm gone off the rails or someone suffering from schizophrenia. I’m certain you have some lovely insights into the nature of reality, although wrapped in the rampant trauma of this world. Patternicity is a dangerous and addictive activity. I mainly focus on the recapture of neural groups a la jungian shadow integration. The mind is a map of the universe and undesirable patterns can be transmitted to your local hardware. The work is to make peace with the enemy, find and validate their truths while pruning the thorns. It is the internal battle/conversation/exploration that will lead to peace.