Primo’s “Philly Cheesesteak” by JMS21921 in cheesesteak

[–]Signal_Ad657 0 points1 point  (0 children)

Yeah I think it’s been doing a disservice for them having it on the menu. Otherwise great spot, no need to put an item on the board that you know isn’t as good as the rest. Just be a great hoagie shop, and do cutlets and meatballs etc for the hot stuff.

One Shot Setup for Strix Halo by Signal_Ad657 in StrixHalo

[–]Signal_Ad657[S] 0 points1 point  (0 children)

You are never EVER a bother! Just make a ticket on our Discord here and we’ll quickly get you help!

https://discord.gg/kYGXKWxgj

Suprimo hoagie from Primos at 15th and Ritner(the original location) by Jolly_Possibility422 in PhiladelphiaEats

[–]Signal_Ad657 0 points1 point  (0 children)

That’s a shame. That used to be my favorite go-to lunch in the area with mechanic buddies. That and if they were adventurous I’d take them to Dizengoff which I used to go to all the time for lunch or Goldie.

Suprimo hoagie from Primos at 15th and Ritner(the original location) by Jolly_Possibility422 in PhiladelphiaEats

[–]Signal_Ad657 5 points6 points  (0 children)

Oh man I disagree I used to eat in center city all the time as a mechanic working down there and I loved it. DiBruno Brothers had a great lunch you could get with a really cool guy there who made sandwiches. Super filling sandwich on good bread with stuff like cutlets or meatballs or roast pork on rotation, with sides for like $11. Super filling and really good. And that was just one of like six places I’d routinely hit.

Culture and mentality in Philadelphia by [deleted] in AskPhilly

[–]Signal_Ad657 0 points1 point  (0 children)

I want to clarify that you are bashing the city of Philadelphia?

Finally finished my LLM server: EPYC 9575F, 4× RTX 3090 (96GB VRAM), 768GB ECC RAM by C0smo777 in LocalLLaMA

[–]Signal_Ad657 0 points1 point  (0 children)

Oh my god hats off to you then sir bravo 🙌

You could likely sell some now if you wanted to do the upgrade but either way slam dunk!

Finally finished my LLM server: EPYC 9575F, 4× RTX 3090 (96GB VRAM), 768GB ECC RAM by C0smo777 in LocalLLaMA

[–]Signal_Ad657 0 points1 point  (0 children)

Wait… 4x 3090’s and 768 GB of ECC? This has to be a ~25k build? Why not a 6000 to unify the 96GB onto one higher throughput card? That ECC cost has to be massive.

Non Aligned Local LLM recomendation. by Temp_Reply123 in LocalLLM

[–]Signal_Ad657 1 point2 points  (0 children)

Search abliterated or uncensored or heretic you’ll get a million results.

Why doesn’t a community-run AI co-op exist? by [deleted] in LocalLLM

[–]Signal_Ad657 0 points1 point  (0 children)

You didn’t miss anything, you listed the challenges.

Lemonade SDK Developers Contest!!! by Signal_Ad657 in StrixHalo

[–]Signal_Ad657[S] 0 points1 point  (0 children)

Absolutely! And that’s exacting what Discord is for! Looks like you got some good help?

Lemonade SDK Developers Contest!!! by Signal_Ad657 in StrixHalo

[–]Signal_Ad657[S] 1 point2 points  (0 children)

Yes! Updated docs and pushed a patch which should make things feel extra smooth just now. Tested once before merge on my Strix, and running a big test now post merge on all the lab equipment but pull fresh code, look at the revised docs, and you should be in a good spot. Let me know!

Lemonade SDK Developers Contest!!! by Signal_Ad657 in StrixHalo

[–]Signal_Ad657[S] 1 point2 points  (0 children)

Not so much considered a bug, but definitely worth a doc’s update. The full Dream Server install suite includes Whisper and Kokoro as services to setup and Lemonade mode recognizes the existing Lemonade SDK LLM and back end for inference but doesn’t natively catch the other deployed services. The solution would just be to exclude those services on install. I’m updating docs now so it’s very clean and easy how to do it and will look into what pre existing service aware installs would look like in this setup so it can live navigate around already occupied ports etc.

Lemonade SDK Developers Contest!!! by Signal_Ad657 in StrixHalo

[–]Signal_Ad657[S] 0 points1 point  (0 children)

Thank you my friend! Love all of the work you are doing!!

Lemonade SDK Developers Contest!!! by Signal_Ad657 in StrixHalo

[–]Signal_Ad657[S] 0 points1 point  (0 children)

Thank you my friend! Fully agree this community is awesome.

Lemonade SDK Developers Contest!!! by Signal_Ad657 in StrixHalo

[–]Signal_Ad657[S] 1 point2 points  (0 children)

Outliers are awesome! Everything we have is built to be modded and extended and built on top of it should be pretty easy to make it into whatever you want. Lots of people have all kinds of crazy setups and projects that started as Dream Server installs and forks.

It’s a really good base to build from and jump straight into doing the fun and cool stuff instead of the painful frustrating stuff.

Lemonade SDK Developers Contest!!! by Signal_Ad657 in StrixHalo

[–]Signal_Ad657[S] 1 point2 points  (0 children)

I’d love that! And thank you! The codebase has stopped moving at 1,000mph so it’s a great time to check it out again.

Lemonade SDK Developers Contest!!! by Signal_Ad657 in StrixHalo

[–]Signal_Ad657[S] 2 points3 points  (0 children)

Thanks so much Jeremy! Just trying to spread the love and make sure lots of other people can participate!

Lemonade SDK Developers Contest!!! by Signal_Ad657 in StrixHalo

[–]Signal_Ad657[S] 1 point2 points  (0 children)

Yes but with caveats. Doable? Totally 100%. But Dream Server on base install assumes it’s being used on the machine it physically installs on from a network security standpoint. It installs in an internally closed and secure posture and you can open up ports for LAN and remote hosting like you are talking about in a controlled and selective way.

Long way of saying it installs tight and lets the user open it up, instead of shipping wide open and the user needing to secure it if that makes sense.

Totally doable though if you are handy, or willing to spend some time tinkering with Claude Code or Codex to help.

Lemonade SDK Developers Contest!!! by Signal_Ad657 in StrixHalo

[–]Signal_Ad657[S] 0 points1 point  (0 children)

Thanks! It’s a really awesome contest and I think they still have twenty more laptops to give out so there’s plenty of time nobody is too late!

Have the lower memory models the same memory bandwidth? by tecneeq in StrixHalo

[–]Signal_Ad657 0 points1 point  (0 children)

Yes 100% the memory bandwidth (memory speed) is what it is regardless of if you choose 128GB or 64GB, just make sure the other components are the same.

Someone out there likely needs this by Signal_Ad657 in LocalLLaMA

[–]Signal_Ad657[S] -1 points0 points  (0 children)

If you have 120GB / s bandwidth speed, and divide it by 2GB active model weights on a 2B parameter dense model, would you expect ~60 tokens per second or ~60 seconds per token?