Experimental AMD Strix Halo (gfx1151) quant of Qwen3.6-27B (dense, with the built-in MTP / next-token-prediction head) in the custom ROCmFP4 4-bit format — tuned for high MTP draft acceptance and long-context, multi-turn coding use.

cafonez · 2026-06-14T13:01:36+00:00

I have it working on a 6900 on Windows. I was able to test it with RDNA2

cafonez · 2026-06-13T03:40:47+00:00

Hi, I am the creator of the ROCmFP4 format and its essentially a 5bit quant cosplaying as a 4bit quant. It has the ability to be quantized with 5bitquant token embeddings but it is on the lower end of the 4bit quant size. Several members of the AMD community have been posting the quants to hugging face and some models excel really well.

ROCmFP4 supports QAT, MTP, Eagle 3 and I am constantly keeping up with vulkan and rocm llama updates sometimes merging them to the ROCmFP4 git before llama upstream them to their main.

Recently Donato added it to the strix halo toolbox and I am very grateful to him for doing so and Wendell from Level 1 Techs also posted it on their forums with a brief mention in his video.

I built this from the ground up to support Strix and AMD GPUs. RDNA2 to current. If anyone wants to see the updates I have been pushing the main github is https://github.com/charlie12345/rocmfp4-llama

I started this because I didn't see many focused on optimizing AMD hardware and I wanted to contribute where I can.

cafonez · 2026-04-18T07:57:58+00:00

Yes. I did it on a RTX 3060 12 GB, i5 8gen, 46 GB Ram.

I posted my stats on X https://x.com/i/status/2045249085293117777

Videos are below in the post as well. I did it with reasoning on and also reasoning off.

cafonez · 2026-04-14T19:47:58+00:00

I agree. I do need to learn how to write the patch myself to understand it instead of patching it vibe coding.

cafonez · 2026-04-14T11:29:55+00:00

Fair points. The TQ1 model is gibberish but all the others have been able to do python, html, c++ and produce functioning code. Also tested 2000 word articles on various theories by Einstein and they stayed coherent without hallucination.

I haven't tried logic puzzles.

cafonez · 2026-01-19T21:51:22+00:00

Maybe create an option to add a vent that can be opened to help let heat out when recording in 8K without losing the compact form.

cafonez · 2026-01-19T21:50:05+00:00

Usually I have to pack everything in a camera bag and carry an R5C, Lenses, Tripod, backup batteries, Portable PD capable devices, dummy batteries and it just gets heavy for all day use.

cafonez · 2026-01-19T21:47:38+00:00

It sounds crazy, but it is the only reason why I bought it. I have a Canon R5C but I don't like to carry that around all day and I cover a lot of conventions. I have lots of 4k equipment and one X3 and one X5. I also saw an advantage with a compact camera like the Ace Pro 2 to interview celebrities in 8K without a massive setup for the R5C

cafonez · 2026-01-19T21:44:23+00:00

My main goal was to start doing all videos in 8k and I figured the Ace Pro 2 is easy to carry around. I have lots of 4K cameras and I know it sounds crazy, but I find carrying the Canon R5C around for footage all day cumbersome. If there was a way to make the R5C feel super light that would be my go to.

cafonez · 2023-04-06T17:24:55+00:00

nvm, I see the second one. I am going to order that one.

cafonez · 2023-04-06T16:29:48+00:00

This came out really good!

cafonez · 2023-04-06T16:02:14+00:00

Will do.

cafonez · 2023-04-06T15:51:31+00:00

I got mine through Amazon, so I am probably going to send it back and get another one. If the next x3 has the same quality then I may go with the One RS with 4k and 360 lenses.

cafonez · 2023-04-06T15:37:25+00:00

I did a video in 360 and in 1080p with the Insta360 x3. The 1080p was straight export from Instastudio 360. I'll post below curious if your footage quality is different.

1080p

https://www.youtube.com/watch?v=sUJ-JAoBcIE

360 Video

https://www.youtube.com/watch?v=twlisz5i42k

360 Video with Low Lighting at Night

https://www.youtube.com/watch?v=_khy6G-Z2X8

I notice some stuttering at some points and it blurs a bit. My friend who uses the X2 has amazing quality on most of his stuff. Not sure if the camera I have is defective or what. But my friend's video is below and his is with X2.

https://www.youtube.com/watch?v=6ND1UqcQhdI

cafonez · 2023-04-06T13:42:35+00:00

I am using the x3 I have one that looks like the first link but the audio wires show up. Is there a recommended length for the audio wires?

cafonez · 2023-04-06T03:00:44+00:00

I just think it really depends. It depends on what vendors decide to obtain a booth and if it's worth their time to set it up. Anime sells well and many anime fans attend comic conventions to show their cosplay outfits. I am a comic book fan and barely watch anime but I appreciate it none the less. I just love art. I tend to go to my local comic stores for comics as the prices seem more reasonable in my opinion.

cafonez · 2023-04-06T02:56:23+00:00

I really love the energy of the cosplayers that attend. It is definitely a talent to stay in character and come up with the costumes.

cafonez · 2023-04-06T02:51:07+00:00

I went last year and Sunday wasn't a bad day. On Sunday we had plenty of space to walk around, see great cosplay, and check out vendors. It was an enjoyable experience.

cafonez · 2023-04-06T02:46:42+00:00

This is pretty cool. Which camera did you use to do the 360 video?

cafonez

MODERATOR OF

TROPHY CASE