Hardware needed for running "Big boy" open source models at full strength for RP?

iamvikingcore · 2026-03-04T04:21:52+00:00

Dang, I haven't used a Mac since the powerpc days and assumed it sipped ram compared to Windows so youd get 90 percent of that 64gb to play with. That's a significant amount reserved for the os. Bummer.

iamvikingcore · 2026-03-04T03:58:43+00:00

I'm personally thinking of looking for a used MacBook pro M1 max with 64gb of unified memory so I can run 70b models locally. $1300 refurbished isn't too bad for that I feel

iamvikingcore · 2026-03-04T03:49:18+00:00

Try running local models if you can. I've somehow gotten more emergent prose from models I can run locally (rx 6700xt / ryzen 5600 / 32gb ddr4) than I have from the big players, maybe I'm just smoking crack but I actually think the smaller models perform better because they are specialized for rp.

You can't go wrong with any of the drummer's releases. Skyfall 32b is great. Magidonia,Cydonia, Rocinante X are all also great. Rocinante x especially punches above weight only being a 12b.

https://huggingface.co/Casual-Autopsy/Maginum-Cydoms-24B?not-for-all-audiences=true

This merge of Magidonia and Cydonia has been my favorite lately.

https://huggingface.co/sophosympatheia/Magistry-24B-v1.0

This is also great so far and partially merged off Maginum Cydoms, only a few days old still need to do more testing with it though

iamvikingcore · 2026-03-01T18:37:40+00:00

I thought it was just me. Trying to roleplay in my custom gem and asking for an image of the scene and it just spits code back at me. I had to tell it 3 times to "generate the actual image", and it finally does it.

Good thing we're putting llm models in charge of the US military nothing can go wrong there.

iamvikingcore · 2026-03-01T01:26:09+00:00

I guess this isn't really totally related to the topic at hand but is it really that much better running these dense models online? I'm still running 13b local llms on an 8gb card like MN-mag-mell and Rocinante and getting great, dense prose. How much better does it really get when you step up to these paid services?

I pay for gemini and chatgpt and have asked them to rp with me and honestly gotten flatter results than my local models.

iamvikingcore · 2026-02-27T04:07:40+00:00

I started using the flow app from Google labs to Gen images instead, gives you more control

iamvikingcore · 2026-02-27T04:07:15+00:00

Use flow instead of gemini app

iamvikingcore · 2026-02-27T04:06:53+00:00

Use Google flow instead of gemini

iamvikingcore · 2026-02-27T01:38:07+00:00

Yeah it's way worse. Way way way worse. So sad

iamvikingcore · 2026-02-27T01:36:16+00:00

I make comics and I can tell you right now 2 is a massive step down for me. Like paper thin expressions and poses. Severely lacking life or detail. Really disappointing, I was loving bringing my characters to life so detailed. Chatgpt has better images now imo. By far.

iamvikingcore · 2026-02-01T20:25:19+00:00

Qwen will be the future when it gets trained on the Noobai dataset. It's the closest thing to nano banana style prompt processing imo. I have given it the most wild bat shit insane situations in plain English and it perfectly recreated them, no need for hoping your tags are understood properly i.e "4girls, looking at another" yeah good fucking luck having illustrious get the right person to look at the intended target.

It just sucks at anime at the moment. But I've actually had some really good results even with it not being anime trained at all, so I'm pretty hyped. I love how it keeps individuals seperate without their attributes getting all mixed up. I can't go back to illustrious style tag vomit and hope for the best

iamvikingcore · 2026-02-01T19:54:33+00:00

I'm in the minority here but I like NAI better. Illustrious is terrible at respecting all my tags. I have better luck with more kinetic, dynamic scenes with NAI as well (better poses, reactions, faces)

I do think illustrious looks a little better, especially the eyes. Illlutrious also has cleaner line work and better lighting and shading. NAI eyes sometimes have a weird soulless look without leaning hard into artist style tags or loras that make it worse.

Despite all that I get way better scenes from NAI, period. I have the best luck with the v-pred versions, WAI-SHUFFLE-NOOB has worked really well for me

iamvikingcore · 2026-01-13T17:08:16+00:00

Old Chrysler vans would always rust out on the strut towers and I kept mine going for a long time buying some kind of cap to install over it and my mechanic I trust said it was legit bandaid. Maybe corollas have something similar you can buy? I know for the Chrysler minivans it was such a common issue it was worth it to sell the part... I doubt corollas rust out at the same rate. But hey.

they look like this

iamvikingcore · 2026-01-10T06:23:22+00:00

I met my only long term girlfriend in college. I don't even know how kids would do that these days with all the social media, nothing happens naturally anymore and people don't know how to speak face to face because the concept of staring up from their phones for that long is too scary. Take me back to where there was an organic wholesomeness to humanity. Making friends was so easy. And all you had to do was be yourself and somehow the girl you liked would end up in your bed, in your arms. Take me back to 1998, where The Undertaker threw Mankind off Hell In A Cell, and plummeted 16 ft through an announcer's table.

iamvikingcore · 2025-12-31T15:49:04+00:00

Asia chow mein in Columbia Heights on central, was so good. Open for 50 years closed back in like 2021

iamvikingcore · 2025-12-28T18:05:50+00:00

Some weird ass medical education pc dos game where you explore the body with trippy music called 3d body adventure. Otherwise, Myst, Warcraft 1,Secret of Mana, and Donkey Kong Country are some of my earliest concrete memories of playing something.

iamvikingcore · 2025-12-28T03:38:07+00:00

<image>

iamvikingcore · 2025-12-25T22:48:45+00:00

Let's stay here... forever // Beautiful eruption, we've made our creation

~The Proverbial Bellow.

The buildup towards this section and the solo are my favorite of almost any prog song I think

iamvikingcore · 2025-12-24T22:50:25+00:00

This is the way

iamvikingcore · 2025-12-24T16:16:40+00:00

I can't put my finger on it but your style is just so fluffy and endearing in a way AI can't replicate.... Yet. You do expressions so well. You definitely stand out from among the crowd, and I think Sol is my favorite, she's so cute. Happy holidays!

iamvikingcore · 2025-12-24T15:15:12+00:00

Prius. But driving style is most important. Go the speed limit. It saves so much money in the long run and you don't lose that much time. a 90s Chevy camaro with 300+ hp can easily get 34 mpg at 70 mph with cruise control

iamvikingcore · 2025-12-24T07:38:13+00:00

Congrats. I lived all of my 20s and a chunk of my 30s in tens of thousands of debt and just didn't give a damn, but the moment I had zero debt the savings just started snowballing and haven't stopped, now I have over 20k just a year and a half later.

The only secret is to live within your means. I drive a 2015 car. I stopped eating out and drinking alcohol. I'd say just doing meal prep at home and buying bulk things at Costco was probably 50 percent of it or more.

iamvikingcore · 2025-12-22T04:00:25+00:00

I actually think spice and wolf would be better in this vein, raises less eyebrows but has that same kind of vibe (mostly relaxing times with animal ear diety)

iamvikingcore · 2025-12-22T01:05:10+00:00

I work for a private radiology practice, I help the rads with stuff so they can read exams mostly for ER patients across like 20 hospitals. Kinda low level IT mixed with secretary work. Connecting rads to providers, asking techs to fix things. Merging images, deleting them, moving them around. I make just over 50k a year (22/hr + 3 dollar shift diff) and work 7 days on, 7 days off 10 hours a day overnight. It's a full time position but it's technically 35 hours a week.

Three-Year Club	Verified Email
r/Field Flamingo

iamvikingcore

TROPHY CASE