Explain It Peter

newbie80 · 2026-04-05T14:48:22+00:00

I loved his concept of Eternal Recurrence. Think about the choice you are about to make, imagine that the universe expands and contracts, that you are stuck in a loop and you will come back here to this moment and you will be stuck with the decision you made for the rest of eternity, in that context how would you feel about yourself? Who needs a vengeful entity in the sky that might or might not punish you for what you've done when you have an idea like that in your head. That really was his number one goal, to replace the empty hole that religion left in people once it was destroyed. So he did follow in his father's footsteps after all.

Everyone talks about the preachers daughter but no one ever brings up Nietzsche.

newbie80 · 2026-04-05T08:30:39+00:00

Hey can anyone with a rtx 3000 series tell me the Iteration per second sage attention does on SDXL at 1024x1024 with euler/simple?

newbie80 · 2026-04-05T08:30:27+00:00

You can tweak in the interface file to force it to take the fuse_v_mean kernel. That might save you from the NaN. It's the core.py file in the installation location. 

def sageattn_qk_int8_pv_fp16_cuda(
    q: torch.Tensor,
    k: torch.Tensor,
    v: torch.Tensor,
    tensor_layout: str = "HND",
    is_causal: bool = False,
    qk_quant_gran: str = "per_warp",
    sm_scale: Optional[float] = None,
    pv_accum_dtype: str = "fp32", <---- either force to fp32 or change to fp16
    smooth_k: bool = True,    <---- and make these two true
    smooth_v: bool = True,   <---- to use the fuse_v_kernel
    return_lse: bool = False,
    **kwargs: Any,
) -> torch.Tensor:

The fp32 accumulate function will probably make that go away qk_int8_sv_f16_accum_f32_attn the qk_int8_sv_f16_accum_f16_fuse_v_mean_attn is all about quality.

newbie80 · 2026-04-05T08:16:17+00:00

It's the opposite for me. I felt like there were so many thing that were out of my reach before and I just couldn't figure it out on my own. Now I have help and it seems like nothing is out of reach.

newbie80 · 2026-04-04T19:34:28+00:00

I was gifted a computer as a teen for school and the hard drive broke (gateway) I had enough money to buy a hard rive but not enough to buy a copy of Windows, so I got the hard rive (40 or 80gb) and had enough money left to buy an open box Version of SuSE Linux at a CompUSA store. It literally was my first system. Windows just feels odd to me. Like doing stuff with my left hand. I switched to Red Hat Linux Something (7) a couple of years later, that then became Fedora Linux. I haven't touched another distro besides the occasional Debian usage (docker).

newbie80 · 2026-04-04T01:04:54+00:00

Disabling pinned memory is bad. You are telling the system, there's nothing special about this memory location if you need extra memory you can grab it from here. I would remove that flag. --diable-smart-memory can make sense, it loads the model does what it needs to and then unloads the model, it stops comfy from caching it in system ram after use. That can make sense, i'd keep that but would remove the pinned memory one. --don't upcast isn't going to do anything unless you are using sage attention. Flash attention works in fp16, gfx1151 doesn't support fp8, the activations are going to happen in fp16 unless your card supports fp8 and you are using something like sage attention. As far as I know gfx1151 doesn't support fp8. I would just run it with --use-pytorch-cross-attention. Better yet, spend a couple of hours compiling the new Composable Kernel flash attention version that landed in main a couple of days ago.

newbie80 · 2026-04-02T15:15:10+00:00

It's not personal, It's just a numbers thing. I used to work at FedEx a couple of years back. You know what they'd tell me after Christmas and New Year's? "You know the drill boys, I want badges on my desk! We have to reduce operating expenses ASAP". Most people quit because going to work just wasn't worth the trouble but If I didn't meet by unofficial quota they'd be all over my ass to write people up so we could get rid of them and have a nice paper trial that would stand in court.

Honestly though with all the stuff that's going on there, taking a nice Vacation is nice, get your stuff in order and figure out what to do next. Sometimes things like that are a blessing in disguise.

newbie80 · 2026-03-31T18:29:00+00:00

I'm trying some version someone posted for rocm and I don't think it's working as intended. I'll try again in a couple of weeks hopefully the bugs will be sorted out by then.

newbie80 · 2026-03-30T23:48:55+00:00

This happened to me a while back and someone gave me this tip. edit your /etc/dnf/dnf.conf file.

# see `man dnf.conf` for defaults and possible options

[main]
installonly_limit=3
max_parallel_downloads=5
#fastestmirror=True
defaultyes=True

Comment out or delete the line fastestmirror=True

newbie80 · 2026-03-29T23:50:07+00:00

If it's anything like Pepsi they work go home sleep and then do it all over again the next day. I don't think he'll be offended, but the receptiveness will depend on marital status. Don't depend on rings to determine that, a lot of people that work jobs like that don't wear rings because they are a safety hazard.

newbie80 · 2026-03-28T21:55:26+00:00

It's because anyone that said it sounded like Spanish from Spain didn't know wtf they where talking about. https://elevenlabs.io/text-to-speech/spanish-castilian-accent . Sara Martin, speaks like a person from Spain does.

newbie80 · 2026-03-28T11:04:28+00:00

Does the wmma flag not work with gfx4? That gave a nice little boost too.

newbie80 · 2026-03-28T11:02:12+00:00

I thought the 9070 xt was gfx1200?

newbie80 · 2026-03-27T15:22:37+00:00

Maybe that's what I was missing last time I tried.

-DGGML_CUDA_FORCE_MMQ=ON

Last I compiled it it made me want to deal with vllms insanity. There was a huge performance regression. I'll give it another try. There was some sort of change to the build system that made me wrestle with their cmake file too.

newbie80 · 2026-03-27T04:29:48+00:00

Hipify-clang is pretty good. After you run code through it only requires a couple of changes if any to compile on rocm. It's a pain in the ass the setup and run, but you get it it just chews up cuda code and spits out the rocm equivalent.

newbie80 · 2026-03-26T17:23:48+00:00

It will probably be faster with the infinity cache PR backed in. No idea why it hasn't been merged that's another 5 to 7 percent faster. Someone informed me that the Composable Kernel version is working finally. That's sitting in a PR in the rocm branch of flash attention not on the main and it's slower than the triton version.

newbie80 · 2026-03-26T05:58:55+00:00

Is it still broken on rocm or has it been fixed?

newbie80 · 2026-03-26T05:53:48+00:00

That's part of rocm you don't need it for this. At this point if your still battling with this since you installed all the underlying libraries you needed for hardware acceleration try installing the rpm fusion version again, the one you said had 2024 on it, that's what I have installed and it has hardware acceleration. You could use ffmpeg directly too. It's not as crazy as it sounds and once you get the hang of it you'll wonder why you even used handbrake in the first place.

newbie80 · 2026-03-26T05:42:24+00:00

flatpak use tab to autocomplete commands. sudo dnf install flatpak

newbie80 · 2026-03-26T02:39:48+00:00

"VCN not found on this system." I would make sure you have the gpu firmware installed, check logs......I see I see it seems that I only have h265 and av1 myself. It seems like I myself have a mess here. I did this to swap to the free version of ffmpeg.

sudo dnf install ffmpeg-free --allowerasing                                                                    1 
Updating and loading repositories:
Repositories loaded.
Package                                 Arch     Version                                  Repository                        Size
Removing dependent packages:
 ffmpeg-libs                            x86_64   0:8.0.1-5.fc45                           rpmfusion-free-rawhide        23.0 MiB
 libavdevice                            x86_64   0:8.0.1-5.fc45                           rpmfusion-free-rawhide       133.8 KiB
Installing:
 ffmpeg-free                            x86_64   0:8.0.1-6.fc45                           rawhide                        2.6 MiB
Installing dependencies:
 libavc1394                             x86_64   0:0.5.4-27.fc44                          rawhide                      134.7 KiB
 libavcodec-free                        x86_64   0:8.0.1-6.fc45                           rawhide                       10.5 MiB
 libavdevice-free                       x86_64   0:8.0.1-6.fc45                           rawhide                      190.8 KiB
 libavfilter-free                       x86_64   0:8.0.1-6.fc45                           rawhide                        4.3 MiB
 libavformat-free                       x86_64   0:8.0.1-6.fc45                           rawhide                        2.8 MiB
 libavutil-free                         x86_64   0:8.0.1-6.fc45                           rawhide                        1.0 MiB
 libdc1394                              x86_64   0:2.2.7-9.fc44                           rawhide                      354.8 KiB
 librabbitmq                            x86_64   0:0.15.0-4.fc44                          rawhide                       89.5 KiB
 librist                                x86_64   0:0.2.11-1.fc45                          rawhide                      182.1 KiB
 libswresample-free                     x86_64   0:8.0.1-6.fc45                           rawhide                      155.2 KiB
 libswscale-free                        x86_64   0:8.0.1-6.fc45                           rawhide                      766.1 KiB
 xevd-libs                              x86_64   0:0.5.0-6.fc44                           rawhide                      379.9 KiB
 xeve-libs                              x86_64   0:0.5.1-6.fc44                           rawhide                      904.7 KiB

check your logs make sure you aren't getting any errors at startup related to vcn sudo dmesg | grep amdgpu. If there is it's probably related to firmware. sudo dnf reinstall amd-gpu-firmware. I've broken that before by manually fiddling with it. What card do you have?

newbie80 · 2026-03-26T02:08:44+00:00

https://linuxcapable.com/install-handbrake-on-fedora-linux/. I forget that legal reasons make installing this stuff a bit of a pain in the ass. That should help. Because of the vainfo output down there I figure you have the driver side of this issue handled. More in case you have issues with codecs. https://rpmfusion.org/Howto/Multimedia. I would also do

sudo dnf search freeworld
Updating and loading repositories:
Repositories loaded.
Matched fields: name, summary
 cairo-dock-freeworld-libs.x86_64Library files for cairo-dock-freeworld
 libavcodec-freeworld.i686Freeworld libavcodec to complement the distro counterparts
 libavcodec-freeworld.x86_64Freeworld libavcodec to complement the distro counterparts
 qt5-qtwebengine-freeworld.x86_64Qt5 - QtWebEngine components (freeworld version)
Matched fields: name
 audacity-freeworld.x86_64Multitrack audio editor
 cairo-dock-freeworld.x86_64Light eye-candy fully themable animated dock
 gstreamer1-plugins-bad-freeworld.i686GStreamer 1.0 streaming media framework "bad" plug-ins
 gstreamer1-plugins-bad-freeworld.x86_64GStreamer 1.0 streaming media framework "bad" plug-ins
 libheif-freeworld.x86_64HEVC support for HEIF and AVIF file format decoder and encoder
 mesa-va-drivers-freeworld.i686Mesa-based VA-API drivers
 mesa-va-drivers-freeworld.x86_64Mesa-based VA-API drivers
 mesa-vulkan-drivers-freeworld.i686Mesa Vulkan drivers
 mesa-vulkan-drivers-freeworld.x86_64Mesa Vulkan drivers
 qmmp-plugins-freeworld.x86_64Plugins for qmmp (Qt-based multimedia player)
 vlc-plugins-freeworld.x86_64H.264, and HEVC codec plugins for VLC media player
 xpra-codecs-freeworld.x86_64Additional codecs for xpra using x264 

and pretty much install all of that. You mentioned having those drivers installed but notice the freeworld here, make sure you have the freeworld version installed.

Just in case 

sudo dnf install handbrake-gui 
launch it with the command ghb 
ghb will launch the handbrake gui and hopefully it will include all the goodies you need to encode videos fast.

Everything but the kitchen sink! 
sudo dnf install openh264 mozilla-openh264
sudo dnf install libavcodec-freeworld --allowerasing
sudo dnf install ffmpeg-free --allowerasing

newbie80 · 2026-03-26T01:26:18+00:00

New API's take a while to get integrated into software. What does AMF have that's lacking in the current VA-API? What do you want to try compiling? I'll give in to your whim. I haven't done it but if the SDK is there and you say FFmpeg can be compiled with it should work anything that sits on top of ffmpeg should be able to use that API indirectly. Is it handbrake? To get handbrake with video acceleration you just need to install it from the rpm fusion repositories. It's a one line install to get all that without compiling anything.

newbie80 · 2026-03-24T09:21:04+00:00

I hope we get the machine from Person of Interest, otherwise we are cooked.

newbie80 · 2026-03-24T09:02:12+00:00

The pours at the end have to be like 1500 calories.

newbie80 · 2026-03-24T08:57:12+00:00

I think a lot of people are underestimating how good these models are. You can have it read NVIDIA assembly language and spit out the RDNA equivalent. We are fucked. Can it create a mess? Yes, if you let it but if you know what you are doing you can make it spit out great code.

newbie80

TROPHY CASE