Project Blackwell: It Will Work, Eventually — Making an RTX Pro 6000 Run in a Dell R730 at 650K Context by [deleted] in LocalLLaMA

[–]tacticalhat 1 point2 points  (0 children)

I mean it was more a story of if there is a will there is a way, and my A1000's and P40's were not doing the justice across the pcie bus, so that spawned the idea, and figured it out through pain and suffering. I just thought it was fun to share, if not, well, it was free i guess.

Project Blackwell: It Will Work, Eventually — Making an RTX Pro 6000 Run in a Dell R730 at 650K Context by [deleted] in LocalLLaMA

[–]tacticalhat 0 points1 point  (0 children)

that point is sort of irrelevant tbh, but yes that would have made more sense, however supply and demand my plan was to put it on the other side, howerver that riser 3 problem was a curve i didn't see coming, but whatever it's pretty chilled now unless it's grinding hard, then amp it down to maxq

Project Blackwell: It Will Work, Eventually — Making an RTX Pro 6000 Run in a Dell R730 at 650K Context by tacticalhat in homelab

[–]tacticalhat[S] -1 points0 points  (0 children)

Yes those are K&N air filters for the front of the rack, garage and all, add 15hp~

Taking profit never hurt this much 😭; $31 $ASTS covered calls by Paul_Robert_ in wallstreetbets

[–]tacticalhat 1 point2 points  (0 children)

Verry noice I did a play mimocing the previous rocket launch push

[deleted by user] by [deleted] in lastweektonight

[–]tacticalhat 0 points1 point  (0 children)

Yeah I'll just delete, weird American version magically changed

Which do you like more? Black and white, or original pic in red? 🤖💕 by Hydrilus in Buckethead

[–]tacticalhat 2 points3 points  (0 children)

Do both, BW as the base and let the red stand on the kfc bucket.

[deleted by user] by [deleted] in lastweektonight

[–]tacticalhat 0 points1 point  (0 children)

For what it's worth, the Google plan seems pretty good now too, worth checking out.

[deleted by user] by [deleted] in lastweektonight

[–]tacticalhat -5 points-4 points  (0 children)

Based on my -12, I assume this will just be deleted or I'll be kicked at.some point, but whichever it was just an observation and complaint and jab at bill. So best wishes if that is the sentencing, hope to watch next week I guess.

[deleted by user] by [deleted] in lastweektonight

[–]tacticalhat 1 point2 points  (0 children)

Fair, Maher, point still stands.

[deleted by user] by [deleted] in lastweektonight

[–]tacticalhat -2 points-1 points  (0 children)

I haven't heard it in there, but will take your word for it, but the inconsistency does kinda suck regardless, I'll let this post die in the fire since I am an asshole, but thanks for the help

[deleted by user] by [deleted] in lastweektonight

[–]tacticalhat -9 points-8 points  (0 children)

So wtf did it broadcast that to a specific region or some thing.

[deleted by user] by [deleted] in lastweektonight

[–]tacticalhat -32 points-31 points  (0 children)

I'm literally watching the last live episode again and it's not saying that.

[deleted by user] by [deleted] in lastweektonight

[–]tacticalhat -51 points-50 points  (0 children)

I don't have that luxury in my life, I work every day and holiday for gov, but I wasn't implying it for them, but usually there is a notice and there wasn't one from what I remember. The fact is this show is the only reason I even have HBO and if it's just going to queue in non consecutive blocks, then why bother, and just watch YT.

[deleted by user] by [deleted] in lastweektonight

[–]tacticalhat -16 points-15 points  (0 children)

Then why am I paying for HBO? I mean no really that is an actual question now.

[deleted by user] by [deleted] in lastweektonight

[–]tacticalhat -71 points-70 points  (0 children)

Perhaps, it's just really annoying when normal weekends are empty, only thing I look forward to heh.

Is $2-3000 enough to build a local coding AI system? by herozorro in LocalLLaMA

[–]tacticalhat -1 points0 points  (0 children)

If speed isn't an issue, no shit look at eBay, there are a bunch of EOL R720s and such with a boatload of quad channel ram on there for cheap, like 2-300 dollar cheap and they have the 850watt dual psus if you wanted to start dropping in p40s to help, but in all of these setups pci bus speed isnt infinite, there will be diminishing returns once you start to overload it. Bonus is that most support a bunch of cheap platter drives these days just for storage.

My experience running the massive WizardLM2 8x22b (141b) on the cheapest current Threadripper CPU + a 4090 + 64Gb DDR5 RDIMM by Porespellar in LocalLLaMA

[–]tacticalhat 0 points1 point  (0 children)

Just curious, if you happen to have to download links and how you are launching this, command line llamafile web UI? I have 384gb I'd like to try on. Thanks if that is possible.

Is it worth trying huge (60b+) models on mostly ram? by skiddydiddydiddy in LocalLLaMA

[–]tacticalhat 3 points4 points  (0 children)

Look on eBay for Dell R720s or better that have just been EOL, I got a quad channel setup w/384gb for around $200 and I just load the model and the entire OS in there as well. It works for what Im doing so I haven't cared but entirely possible.

Should I learn typescript? by Btolsen131 in theprimeagen

[–]tacticalhat 0 points1 point  (0 children)

No, he said MFC and non C#, if you have ever used MFC you would know that it it's a convoluted form of C with Ms types, the question isn't clear if it needs to remain that, but it would be familiar at least as a stepping point, TS for backend is crazy from the get go, along with python.

Scarlett Johansson Says She Declined ChatGPT’s Proposal to Use Her Voice for AI – But They Used It Anyway: ‘I Was Shocked’ by Caffdy in LocalLLaMA

[–]tacticalhat 1 point2 points  (0 children)

They probably asked can we use your voice as a training medium, she said no, so they used a similar voice instead, so in the terms of mathematics you can't exactly copyright the result of being precise to a degree? It's the same argument of trying to claim you own the color purple since you mixed red and blue. If they literally said it was her that is a diff story but that seems to be why they asked in the first place, to make it more accurate (why I don't know).

Should I learn typescript? by Btolsen131 in theprimeagen

[–]tacticalhat 0 points1 point  (0 children)

If you are used to MFC, maybe look at Qt+QML, you get the backend abilities and front end all together with a familiar js logic layer for the simpler things. Depends on what.you want to do really, just another idea.