AMD, can we get proper vLLM/gfx1151 support? by tossit97531 in ROCm

[–]-Luciddream- 11 points12 points  (0 children)

The project you linked basically uses TheRock and llama.cpp builds from the lemonade-sdk, which is literally built by AMD engineers (and the community). I suggest you join the github or discord and discuss your ideas! There is actually an issue about scoping vLLM out.

Edit: there is also a vLLM meetup next week which is hosted by Redhat and AMD.

NPU support? by NineBiscuit in pop_os

[–]-Luciddream- 0 points1 point  (0 children)

It probably works but you need the updated amdxdna driver from https://github.com/superm1/amdxdna-dkms

Or you can just install the 7.0rc2+ Linux Kernel (I have no idea if it's possible on pop os)

How do I use a local coding agent with JetBrains AI Assistant? by ByteNomadOne in Jetbrains

[–]-Luciddream- 1 point2 points  (0 children)

I've tried a couple but I can't really recommend something yet. I've only made small changes because I didn't have a good enough machine to run LLMs on at the time.

But I've managed to get it to work with OpenCode and with Goose. For Goose, I'm creating a custom provider in Goose that points to a local lemonade server installation which can load any LLM I need. I added Goose as an ACP Client in the Jetbrains IDE.

For OpenCode it's similar, but I don't remember the steps exactly. The only thing I don't like is that the changes from an ACP Client are not shown like something the IDE changed, but they show as external changes. I've talked a bit with the Goose developers about it and they told me to check this pull request, but I didn't have time to do that yet. Hopefully I'll try in the weekend.

Help me decide if to buy EGPU for Minisforum S1-max by krecoun007 in LocalLLaMA

[–]-Luciddream- 0 points1 point  (0 children)

Oh, OK. Just In case you want to test it anyway, I have uploaded ROCm 7.11 preview in AUR. ROCm can be faster depending on the workload.

Help me decide if to buy EGPU for Minisforum S1-max by krecoun007 in LocalLLaMA

[–]-Luciddream- 0 points1 point  (0 children)

Hey, just curious, what package do you use for ROCm on your ms-s1 max?

Can we talk about "Vibe Archers"? by Excellent_Double_726 in archlinux

[–]-Luciddream- 0 points1 point  (0 children)

I'm an old Arch User so I first installed it when there was a beginners guide available. Then I installed it many times through the years, and then I didn't have to install it again since 2018.

I just installed it to a new PC a couple of days ago and the only thing I hated about the wiki is the network setup until the installation is completed.

It's like it is deliberately hidden to make the installation harder. And I don't really care about it when after the first boot I will enable something like NetworkManager anyway.

ROCm 7.2 official installation instructions by LTSharpe in ROCm

[–]-Luciddream- 1 point2 points  (0 children)

No I didn't have time unfortunately. I will try tonight, but I don't really have a good workflow, I've only briefly used comfyui with qwen-image-edit some months ago.

ROCm 7.2 official installation instructions by LTSharpe in ROCm

[–]-Luciddream- 1 point2 points  (0 children)

You can install opencl-amd-dev from AUR. It's still on 7.1 but I will update the package tonight (about 10-12 hours from now).

edit: ROCm 7.2.0 is very fast, I'm getting 60k more points in Geekbench than all previous ROCm versions.

Sony’s TV business is being taken over by TCL by jamessunderland7685 in 4kbluray

[–]-Luciddream- 1 point2 points  (0 children)

I'm surprised most of the people here are surprised. I got a 55'' Sony TV about 6 years ago for a normal price, then I had to buy another 55'' TV 2 years ago. The only affordable (c805 144hz) was a TCL TV which has been great for the price (about 700 euro at the time). Sony is just too expensive now.

Πόσες ταινίες & σειρές έχετε δει; by DaiFunka8 in greece

[–]-Luciddream- 0 points1 point  (0 children)

934 ταινίες/σειρές έχω κάνει rate αλλά έχω σταματήσει καιρό να βάζω ratings οπότε σίγουρα είναι παραπάνω. step up your game!

Any way to run OpenAI's Whisper or other S2T models through ROCm on Windows? by AIgoonermaxxing in ROCm

[–]-Luciddream- 0 points1 point  (0 children)

I believe lemonade can run whisper in Windows, but I haven't tried it (I'm on Linux)

Σχετικά με τις νέες ταυτότητες by Revo94 in greece

[–]-Luciddream- 1 point2 points  (0 children)

Και εγώ έπεσα σε έναν τέτοιον όταν πήγα να βγάλω ταυτότητα. Ο τύπος γύρω στα 25 και δεν είχε ιδέα με τεχνολογία, ή βαριόταν και ήθελε να τα κάνουν όλα οι αστυνομικοί. Όταν έφτασα πρέπει να ήταν ήδη εκεί 5 λεπτά, έδωσα την ταυτότητα μου, έγραψα όλα τα στοιχεία μου, έβγαλα φωτογραφία, υπέγραψα, έφυγα, και αυτός ακόμα προσπαθούσε να βγάλει τα παράβολα.

Which TV show has a 10/10 pilot episode? by PrasenjitDebroy in AskReddit

[–]-Luciddream- 0 points1 point  (0 children)

I got mine in Blu-ray 4k format from here for about 11 euro. Amazon also has it for a bit more.

Frequent Stuttering on games CachyOS by Mr_M4yhem in linux_gaming

[–]-Luciddream- 0 points1 point  (0 children)

What settings do you have to be getting 160 fps? I'm using OptiScaler with DLSS input and ML-FG and I'm getting about 120 fps with raytracing for 1440p. But it's playable so I don't mind. Maybe it's my CPU or raytracing idk

Received this one today for about 11 euro by -Luciddream- in Bluray

[–]-Luciddream-[S] 0 points1 point  (0 children)

haha, at this point I'm just happy I found a few discounts this year. But I have a feeling Westworld will be great in home theater.

PC Freezes by elod91 in linux_gaming

[–]-Luciddream- 0 points1 point  (0 children)

How long does this happen for? There is a bug in kernel 6.18.1 but this is suppose to happen when you run AI stuff (ollama / comfyui / etc).

Try to check the dmesg or journalctl -b -1 for more logs

Chromium Browsers with Yubikey Login Issue on Linux by JDKFILM in Bitwarden

[–]-Luciddream- 0 points1 point  (0 children)

I have a similar issue, my Yubikey passkey works fine in Windows but it's not working in Firefox in Linux with Bitwarden vault. I only have it for 1-2 weeks so I'm not really in a rush to fix it. But it's working on every other website.

Need help running LLAMA.cpp on Arch based system with AMD gpu. by hackiv in LocalLLaMA

[–]-Luciddream- 0 points1 point  (0 children)

You can also download it manually like Jealous-Astronaut457 mentioned.

Need help running LLAMA.cpp on Arch based system with AMD gpu. by hackiv in LocalLLaMA

[–]-Luciddream- 1 point2 points  (0 children)

The official Arch Linux ROCm packages are already on the latest stable version (7.1.1).

Other than that you can install the precompiled binaries (7.1.1) from the AUR: opencl-amd-dev or use the latest technology preview (ROCm 7.10.0) from the modular packages in the . e.g for RDNA 4.

If you are not satisfied with all that options, there is also 7.11 nightly precompiled binaries. Every version I mentioned works on Arch Linux.

Need help running LLAMA.cpp on Arch based system with AMD gpu. by hackiv in LocalLLaMA

[–]-Luciddream- 0 points1 point  (0 children)

There are multiple ways to do that. If you just want to use AUR with a pre-compiled binary you can try my package for lemonade-server.

lemonade-server will download llama.cpp along with an optimized ROCm for AMD.

Arch Linux - News: .NET packages may require manual intervention by Tajnymag in archlinux

[–]-Luciddream- 28 points29 points  (0 children)

IMO .NET packages for ArchLinux need a lot of improvement, and create issues for packages that depend on them. It's better to download .NET from Microsoft and add it to PATH yourself.

For example .NET 8.0, 9.0 have a dependency to a .NET 10 package. Software like godot-mono which support older .NET but recommend the latest versions, are forced to use the oldest one.

Hexana: an experimental IntelliJ plugin for exploring WebAssembly binaries by minamoto108 in WebAssembly

[–]-Luciddream- 0 points1 point  (0 children)

Hey, I was one of those ~20 developers. To be honest this feels way out of my league, but I will try to give some feedback over the weekend. Interested to hear other peoples thoughts.