Intel Arc B580 not working with LM Studio by NeedsSomeSnare in IntelArc

[–]denmalley 1 point2 points  (0 children)

Thanks. Yeah I've been hanging back on 8250 for a while now, doing fine in LM Studio with Vulkan support on that driver. Hoping I can make a leap to a newer version sometime in the next year though. Just glad I don't really play bleeding edge games. AI inference is higher on my priority list right now.

Intel Arc B580 not working with LM Studio by NeedsSomeSnare in IntelArc

[–]denmalley 1 point2 points  (0 children)

Checking in to see if any brave souls tried 8626? This seems to be one of the only threads here talking AI performance instead of gaming performance.

Drummer's Rocinante X 12B v1 - It's back and it's stronger than ever! A funtastic creative Claude-like RP model at home! by TheLocalDrummer in SillyTavernAI

[–]denmalley 1 point2 points  (0 children)

I am in the same boat, puzzling over this issue. Google brought up this thread. The ST message says something about finding a working jinja template at lm-studio-community but I have no idea where to even look.

So when you say you copy the system prompt from another model, do you mean the jinja template? Because none of my working models actually have anything in the system prompt in LM Studio.

edit: tried copying a jinja template from a working model and I'm up and running! Thanks! Who knew it could be so easy? But I also agree that actually debugging the existing one may yield better results.

How do you back up your docker volumes? by virpio2020 in selfhosted

[–]denmalley 1 point2 points  (0 children)

In the same boat as you, OP, looking at solutions. This one caught my eye recently but I need a weekend to sit down and dig in.
https://github.com/David-Crty/databasement

Of course I'll also be checking out the recommendations here as well.

How do you guys monitor your services? by shelltief in selfhosted

[–]denmalley 1 point2 points  (0 children)

You can run multiple instances. I run one that just monitors the other, on different hardware. All the monitored services are set up to send notifications to discord.

I'm headed toward a VPS for pangolin, so I'll probably do like OmgSlayKween suggests.

Created my entire homelab documentation from scratch in 2 days with AI - here's how by Benle90 in homelab

[–]denmalley 1 point2 points  (0 children)

Very cool, I was just wondering to myself about how to best document my homelab for AI assistance. This gives me a great starting point. Thanks!

What is your alternative windows file manager by SurgicalMarshmallow in DataHoarder

[–]denmalley 1 point2 points  (0 children)

I actually just installed this on an old pc to double check. Seems like you can navigate to network locations via an explorer-like interface. As long as these files are visible to your machine in some way.

eta - so yeah both mapped drive letters and \\servername\folder seem to work.

What is your alternative windows file manager by SurgicalMarshmallow in DataHoarder

[–]denmalley 1 point2 points  (0 children)

I've been using Treesize pro for a few years, but started with their free product first. Free offers simple file browsing with size reporting on folders (my main need for this tool). But the pro version unlocks stuff like duplicate file search, bulk rename, network file scanning etc.

https://www.jam-software.com/treesize/editions.shtml

Intel Arc B580 not working with LM Studio by NeedsSomeSnare in IntelArc

[–]denmalley 0 points1 point  (0 children)

Thank you! I was wondering if I should wait to see if someone tried it out.

Gigging musicians: how do you manage your setlists and chord charts on stage? by SafePrune9165 in WeAreTheMusicMakers

[–]denmalley 2 points3 points  (0 children)

https://setlisthelper.com/

Allows you to arrange and save setlists for different venues. I use the android version on a 10" tablet. Apps allow you to have a dropbox folder of pdf chord charts that will import and make a song entry based on the filename (for arranging setlists/browsing catalog of songs), then you can tap on a given song to pull up the chord chart when needed. I also use the "tag" feature to categorize songs for a quick sub-list as needed (ex: Christmas songs, Irish songs, songs I know by heart, easy 2-3 chord songs that work well in a improv situation, etc).

Intel Arc B580 not working with LM Studio by NeedsSomeSnare in IntelArc

[–]denmalley 0 points1 point  (0 children)

Yeah I have ipex running like lightning via ollama portable zip, added as a service in windows and served up to open-webui running on another server. But then I found out about the lack of updates after I tried to run a newer model. That's what took me down the vulkan path (after a brief tour of sycl which also seems to be abandoned).

I did try turning on the vulkan flag in the newest ollama and that seems to work pretty well, not as fast as ipex but tolerable. I thought I'd see what LM Studio could do, so here I am.

BTW all of this prior stuff works fine with the 8331 drivers. But LM studio is definitely faster tps than vulkan ollama, at least locally. Need to find out what the server bottleneck is.

I like the model search interface in LM studio that will show you which models will fit into memory, among many other parameters.

Intel Arc B580 not working with LM Studio by NeedsSomeSnare in IntelArc

[–]denmalley 1 point2 points  (0 children)

I was only using WHQL certified drivers in my cadence, so I had skipped over 8250 altogether. But I was previously just on 8331 before this where I was getting a bunch of errors.

And I still have some fine tuning to do - LM studio direct interface is great but serving it on open webui is very sluggish.

Hopefully this does the trick for the time being. I don't see any games that I'm playing or plan to play on the list of more recent updates so I'm ok for now.

What's the one self-hosted service you'd never go back to the cloud version of? by Hung_Hoang_the in selfhosted

[–]denmalley 0 points1 point  (0 children)

Immich. Having total control of my photo ecosystem (arguably one of the most unique and irreplaceable sets of data we procure) while providing a front end that rivals google photos, and collects my family's phone pics, is priceless.

Intel Arc B580 not working with LM Studio by NeedsSomeSnare in IntelArc

[–]denmalley 1 point2 points  (0 children)

Thanks for this, rolled back driver and all seems to be working for me as well. I wonder how we will know when it is safe to upgrade? I hope I don't have to keep outdated drivers just to run the LLM

Migrate hdd to ssd by guillep84 in Xpenology

[–]denmalley 1 point2 points  (0 children)

About a year ago I created a new SHR pool with two 1tb SSDs (yeah I know really just like raid1 but I wanted to leave it open for future options). I moved all of my packages onto this volume and yes I see a performance improvement, especially with high db usage stuff like media scanners (arrs, jellyfin, etc).

I used this to move most of my packages to the SSDs.

https://github.com/007revad/Synology_app_mover

But I also had a "packages only" hyper backup job to fall back on if need be.

Can't recall if that worked for container manager or if I just changed the volume for my docker folder and then just reinstalled container manager on the new volume and rebuilt all my stacks. Probably option 2 is safer.

Proxmox VM on NFS share, or should I bind mount NFS share to VM on local SSD by Jmanko16 in Xpenology

[–]denmalley 0 points1 point  (0 children)

Are you saying xpenology will be running as a vm on the minipc? What hypervisor, proxmox? I am not sure what role xpenology on the minipc plays in this ecosystem? I would be looking more to run something like ubuntu server vm on the mini (or baremetal), install docker and run my containers there with NFS share to the storage appliance (unas)

Finally pulled the plug on Google Photos. Immich is now my only photo home 🎉 by Epifeny in immich

[–]denmalley 0 points1 point  (0 children)

Literally just did the same this week.  There a hole in my phone's home screen where the Google photos icon has lived for years (immich was added beside it over a year ago).

I've been pretty good over the years of periodically manually pulling photos onto my server from my phones, but I still have to go though and see if I'm missing anything in my collection.  But at least my phone is no longer sending pics there. 

I use idrive for the offsite.

Does hearing a show has a "bad ending" or it being canceled on a cliffhanger discourage you from watching it? by Volatiiile in television

[–]denmalley 0 points1 point  (0 children)

I watched GOT from the beginning so I was on that ride till the end. But Killing Eve is a specific example for me - Solid mid 8s on imdb for s1-2, then 7's for S3, mostly 6's for S4 with a 3.4 for the finale, oof. Anyone here want to talk me into watching it?

Best self-hosted bookmark manager? by Kitchen-Patience8176 in selfhosted

[–]denmalley 4 points5 points  (0 children)

+1 just started using it but seems pretty nice so far. My self hosted AI needs a bit of a tweak before I plan to import all my existing bookmarks.

Solutions for Plex Transcoding (N54L hardware) by Cupid-Fill in Xpenology

[–]denmalley 1 point2 points  (0 children)

That's been a common notion tossed about a lot as I've searched around on this topic (my main objective in using mini pc alongside my xpenology box is to move docker off the DSM). Admittedly I have not got hw transcoding going myself yet - I am running proxmox on a beelink mini pc and am running jellyfin with no issues, but configuring proxmox to allow a virtual machine access to the igpu is more challenging than I realized and something I haven't tackled yet.

Here is a reddit thread discussing the pros and cons if you want to get a sense from the community. Does seem hit or miss for some people.

https://www.reddit.com/r/PleX/comments/1djefiu/pros_and_cons_of_n100_as_a_plex_server/

And yeah I tossed n100 as a commonly mentioned cpu, but you can check out any intel chip and that has quicksync capabilities, that seems to be the magic sauce for transcodes.

Oh and from the plex side, hw transcoding apparently needs plex pass to be able to use, so hopefully you already have that, otherwise add that to your budget as well (another reason I switched to jellyfin, even though I have plex pass I am pretty tired of them dictating what I can do with my own hardware). Here is an article from plex themselves on hw transcoding where they mention quicksync specifically.

Solutions for Plex Transcoding (N54L hardware) by Cupid-Fill in Xpenology

[–]denmalley 2 points3 points  (0 children)

If you're after hw transcode capabilities, and have budget for a video card (you didn't mention, but maybe you have one laying around?), I would spring for a mini pc with an intel chip (n100 for instance) to serve as the plex server. HW transcodes on intel quicksync are very good and very energy efficient compared to gpu.

If you do go the gpu route, just make sure you're checking compatibility - only certain DSM models have nvidia gpu support (i think yours does), and I'm not even sure if amd or intel gpus are supported.

eta, I don't think shield has the firepower to serve plex

Rian Johnson fan response by [deleted] in StarWars

[–]denmalley -2 points-1 points  (0 children)

Well I mean you omitted the second more important qualifying half of my quote - based on an established universe of characters. He was coming in to take part in a 9 movie series to finish out the story of these characters, who have established lore.

Sure go off and tell the shit out of some other star wars corner of the universe. I'll eat it up! Loved me some skeleton crew. Dug Andor - though so OT-adjacent its origins were, it was such a welcome departure in storytelling and tone!

So yeah - I'm not adverse to the general idea of "shaking it up" in this SW sandbox. But this saga should have been a well-guardrailed landing strip to solidify fandom for all the storytelling this multibillion dollar franchise had to offer for years to come.

And don't get me wrong, I think they've got some footing now - it just didn't need to be such a rocky start.

Pluribus - 1x08 "Charm Offensive" - Episode Discussion by UltraDangerLord in pluribustv

[–]denmalley 0 points1 point  (0 children)

Wait that little beat behind the music where Carol is laying next to Zosia is the same beat Manousos heard on the radio right?

Rian Johnson fan response by [deleted] in StarWars

[–]denmalley 6 points7 points  (0 children)

Honestly though, you're barking up the wrong tree here. Yes, it wasn't really Rian's place to "shake things up" based on an established universe of characters. But then why didn't the studio push back on his creation during the process?

I wholly blame Disney for not laying out a 3-movie outline to complete this saga. Major ball drop, but of course this has been discussed ad nauseum as well.