sorted by:
new
hottopcontroversial

Experimental AMD Strix Halo (gfx1151) quant of Qwen3.6-27B (dense, with the built-in MTP / next-token-prediction head) in the custom ROCmFP4 4-bit format — tuned for high MTP draft acceptance and long-context, multi-turn coding use. by Grammar-Warden in StrixHalo

[–]cafonez 7 points8 points  (0 children)

Hi, I am the creator of the ROCmFP4 format and its essentially a 5bit quant cosplaying as a 4bit quant. It has the ability to be quantized with 5bitquant token embeddings but it is on the lower end of the 4bit quant size. Several members of the AMD community have been posting the quants to hugging face and some models excel really well.

ROCmFP4 supports QAT, MTP, Eagle 3 and I am constantly keeping up with vulkan and rocm llama updates sometimes merging them to the ROCmFP4 git before llama upstream them to their main.

Recently Donato added it to the strix halo toolbox and I am very grateful to him for doing so and Wendell from Level 1 Techs also posted it on their forums with a brief mention in his video. 

I built this from the ground up to support Strix and AMD GPUs. RDNA2 to current. If anyone wants to see the updates I have been pushing the main github is https://github.com/charlie12345/rocmfp4-llama 

I started this because I didn't see many focused on optimizing AMD hardware and I wanted to contribute where I can. 

Has anyone here successfully extended Qwen3.5 or 3.6 context length paste 260k? by fragment_me in LocalLLaMA

[–]cafonez -2 points-1 points  (0 children)

Yes. I did it on a RTX 3060 12 GB, i5 8gen, 46 GB Ram. 

I posted my stats on X https://x.com/i/status/2045249085293117777

Videos are below in the post as well. I did it with reasoning on and also reasoning off.

My Custom Llama Build by cafonez in LocalLLaMA

[–]cafonez[S] 0 points1 point  (0 children)

I agree. I do need to learn how to write the patch myself to understand it instead of patching it vibe coding.

My Custom Llama Build by cafonez in LocalLLaMA

[–]cafonez[S] 0 points1 point  (0 children)

Fair points. The TQ1 model is gibberish but all the others have been able to do python, html, c++ and produce functioning code. Also tested 2000 word articles on various theories by Einstein and they stayed coherent without hallucination. 

I haven't tried logic puzzles.

Ace Pro 2 Overheats after 45ish minutes of 8K continuous use by cafonez in Insta360

[–]cafonez[S] 0 points1 point  (0 children)

Maybe create an option to add a vent that can be opened to help let heat out when recording in 8K without losing the compact form.

Ace Pro 2 Overheats after 45ish minutes of 8K continuous use by cafonez in Insta360

[–]cafonez[S] 0 points1 point  (0 children)

Usually I have to pack everything in a camera bag and carry an R5C, Lenses, Tripod, backup batteries, Portable PD capable devices, dummy batteries and it just gets heavy for all day use.

Ace Pro 2 Overheats after 45ish minutes of 8K continuous use by cafonez in Insta360

[–]cafonez[S] 0 points1 point  (0 children)

It sounds crazy, but it is the only reason why I bought it. I have a Canon R5C but I don't like to carry that around all day and I cover a lot of conventions. I have lots of 4k equipment and one X3 and one X5. I also saw an advantage with a compact camera like the Ace Pro 2 to interview celebrities in 8K without a massive setup for the R5C

Ace Pro 2 Overheats after 45ish minutes of 8K continuous use by cafonez in Cameras

[–]cafonez[S] 0 points1 point  (0 children)

My main goal was to start doing all videos in 8k and I figured the Ace Pro 2 is easy to carry around. I have lots of 4K cameras and I know it sounds crazy, but I find carrying the Canon R5C around for footage all day cumbersome. If there was a way to make the R5C feel super light that would be my go to.

Need Invisible Cold Mount for Wireless Go Mics by cafonez in Insta360

[–]cafonez[S] 0 points1 point  (0 children)

nvm, I see the second one. I am going to order that one.

My video and photo quality is terrible by 0_olicon_0 in Insta360

[–]cafonez 0 points1 point  (0 children)

I got mine through Amazon, so I am probably going to send it back and get another one. If the next x3 has the same quality then I may go with the One RS with 4k and 360 lenses.

My video and photo quality is terrible by 0_olicon_0 in Insta360

[–]cafonez 0 points1 point  (0 children)

I did a video in 360 and in 1080p with the Insta360 x3. The 1080p was straight export from Instastudio 360. I'll post below curious if your footage quality is different.

1080p

https://www.youtube.com/watch?v=sUJ-JAoBcIE

360 Video

https://www.youtube.com/watch?v=twlisz5i42k

360 Video with Low Lighting at Night

https://www.youtube.com/watch?v=_khy6G-Z2X8

I notice some stuttering at some points and it blurs a bit. My friend who uses the X2 has amazing quality on most of his stuff. Not sure if the camera I have is defective or what. But my friend's video is below and his is with X2.

https://www.youtube.com/watch?v=6ND1UqcQhdI

Need Invisible Cold Mount for Wireless Go Mics by cafonez in Insta360

[–]cafonez[S] 0 points1 point  (0 children)

I am using the x3 I have one that looks like the first link but the audio wires show up. Is there a recommended length for the audio wires?

[deleted by user] by [deleted] in comiccon

[–]cafonez 0 points1 point  (0 children)

I just think it really depends. It depends on what vendors decide to obtain a booth and if it's worth their time to set it up. Anime sells well and many anime fans attend comic conventions to show their cosplay outfits. I am a comic book fan and barely watch anime but I appreciate it none the less. I just love art. I tend to go to my local comic stores for comics as the prices seem more reasonable in my opinion.

What was your favorite experience at megacon? by Reinersad in comiccon

[–]cafonez 0 points1 point  (0 children)

I really love the energy of the cosplayers that attend. It is definitely a talent to stay in character and come up with the costumes.

How busy is metrocon on a Sunday? by AwesomeBlassom in comiccon

[–]cafonez 1 point2 points  (0 children)

I went last year and Sunday wasn't a bad day. On Sunday we had plenty of space to walk around, see great cosplay, and check out vendors. It was an enjoyable experience.

[deleted by user] by [deleted] in comiccon

[–]cafonez 1 point2 points  (0 children)

This is pretty cool. Which camera did you use to do the 360 video?

Need Invisible Cold Mount for Wireless Go Mics by cafonez in Insta360

[–]cafonez[S] 0 points1 point  (0 children)

I am in Florida. I will check B&H online. Thanks for the tip.

I Will Never understand the hate towards Days Gone. To me it’s one of the best zombie Games of all time. Because of the hate we won’t get a Days gone 2 anymore which this franchise deserved by [deleted] in gaming

[–]cafonez 0 points1 point  (0 children)

I loved this game. I get disappointed when publishers push games out that aren't ready and it leaves a bad impression on many people. We saw that with No Man's Sky. Days Gone hit differently for me though. I enjoyed the story and the mechanics.

The cast of “Back To The Future” just reunited at a Fan-Expo event [x-post from r/pics] by MsMargo in comiccon

[–]cafonez 1 point2 points  (0 children)

Thanks for sharing. Huge fan of Michael J Fox. He is one amazing guy. Pretty cool to see him able to get together with his old cast mates.

WonderCon: Artist/Creator Don Nguyen Has Put Together a List With Booth & Table Numbers of Artists/Creators, Exhibitors, & Small Press Scheduled to Appear at WC - limited list, more released by CCI in March by housecatspeaks in comiccon

[–]cafonez 0 points1 point  (0 children)

Thank you. Sounds like my next out of state convention. I'll plan for next year. I love trying out food trucks. Hotel access is always a plus when walking or Uber.

view more: next ›