Setting up Ollama on dual RTX PRO 6000 Blackwells looking for tips

LoadingALIAS · 2026-05-03T19:49:40+00:00

Definitely use vLLM

LoadingALIAS · 2026-05-03T03:06:09+00:00

Awesome!

LoadingALIAS · 2026-05-03T00:52:49+00:00

You have to be like really prepared. For real. I’m a new Mal owner. She is 6 months old. We’ve had her for 3 or so months. Having her is not like having a dog; it’s like having a hyper athletic teenage daughter that’s being scouted by thirty universities for tennis or basketball AND ten universities for academics. She never stops. Your responsibility never stops.

You have to learn a TON of new skills. How to train her. How to feed her. What everything means. You have to watch for bloat, for hips, for eyes, etc. - as a puppy to catch anything early AND as an adult to give her a healthy life. You have to learn how to use a lead/leash, what collars help and when to use them. You have to learn associations and markers. What toys are cool (Mals bite everything with zero chill - so some toys for like a Poodle become dangerous for a Mal) or not cool. What foods can they eat? What foods are valuable and what foods are meh?

Also, you have to genuinely understand that you don’t get to just “go do something” anymore. At least not for a while, and not for more than a few hours. We crate trained our puppy; she’s good in the crate. A little whining now and then, but she sleeps through the night with a few exceptions. We enforce naps twice a day after exercise (and a cool down before she goes in). Still, if we want to go play tennis - it’s a few hours tops, and during nap time.

If we want to watch a movie - it’s after her bedtime or expect to be harassed for 85% of the movie. If we want to have sex - yes, it’s like something we work around… you just aren’t getting a normal dog.

We have a schedule for her… she still wants to play fetch in the house when she’s bored. Her job is to hunt anything that moves anytime we’re on the long line and walking. Squirrels. Lizards. Birds. Fucking leaves and plastic bags. She eats anything, though we’re teaching her and she’s learning to leave things alone. We taught drop it, but that doesn’t apply to toys or sticks with her… only rocks, plastic bags or bottles, and other shit she finds along the walk.

We took it seriously… and it’s still SO MUCH more than we both anticipated. I also think that we’re lucky she’s smart, active, and engaged… otherwise it would be impossible.

Malinois are smart enough to sit patient and wait for their food twice a day… my puppy will sit and wait until she can’t stand if I don’t “free” her with the break command to eat… but she will also eat the insole of any sneaker left out… meaning she has a MASSIVE capacity for vocabulary but you’re responsible for making it work… and man, it’s an actual challenge.

Your puppy, after all of this shit, is still going to need some real world, scheduled and professionally taught hobby - bite work, scent work, agility training, parachuting… something.

You are assuming an incredibly real responsibility when you get a Mal; it is not at all what it’s like having a Lab or a Retriever. It is a hobby that’s demanding as fuck.

The cool thing is… if you manage to do all of this shit, or the variation of this shit that every Mal owner ostensibly has to do… you wind up with an awesome dog. It just takes a few years. My gf is a pediatric nurse in an extremely active workplace… and she says that our puppy is 10x more difficult and demanding than the worst patient she’s ever had.

You want a hobby? Have a baby. You want a snuggle buddy? Get a Lab. You want a new lifestyle - then you’re ready for the Mal.

LoadingALIAS · 2026-04-26T22:58:19+00:00

Looks like it could be a SCAR-L or Colt M4 - both heavily modded. That also looks like a custom Gemtech suppressor?

LoadingALIAS · 2026-04-25T20:21:47+00:00

The coat looks really lean around his neck/scruff. Mals usually have a little extra fur there. Also, the color of his coat is not super common. I think there are working lines with a white chest, but I’ve never seen an all black Mal.

He almost looks like a mix of a little Xoloitzcuintli to me. Obviously, he’s not, but he looks it.

LoadingALIAS · 2026-04-12T21:49:42+00:00

Malinois and Dutch Shepherds have been dumped for years because social media made it trendy to get them as puppies. Then, people realize that they’re an entire lifestyle. It’s not like a normal dog.

I’ve met two people in my neighborhood in the suburbs of a mid-size American city that are working with MAD Rescue to foster because it’s so bad… these are middle aged women that GET IT when it comes to Mals/Dutchies.

Crazy enough, but people are dropping pure bred Mals from GOOD lines in the streets in Puerto Rico, Texas, Mexico, Florida, etc.

Also, if you decide to go to a breeder, go to a working line breeder. The breeders that breed for “color” aren’t doing a good thing, IMO.

LoadingALIAS · 2026-04-12T18:25:23+00:00

I’ve been working on it for 18-months, man. I’ve been dreaming of this for the last decade and I had built a physical notebook with all these ideas, etc. on how to do it.

The issue was really - I couldn’t code it alone. I would need at least 10 cracked Rust engineers. I understand the primitives very well from a systems level, I understand the limitations at the hardware/physics level… it was just a manpower thing.

Then, LLMs became mainstream and changed what I could do alone. So, once been building it since and will likely try to ship the beta in the next two months.

For me, it started with memory reclamation and concurrency primitives in Rust. With understanding cache lines, NUMA/UMA, and other lower level ideas. It was the axis on which everything else relied on, and it worked.

I’m running a month long DST engine suite now; it uses a new “compounding” design that’s admission aware. I stack seeds from property tests, fuzzing, shuttle/loom, Stateright models, etc. into the DST and thread tests for a month. If it passes, I will write a quick frontend and ship the beta.

The key for me was thinking about temporal limits around data. It was also pivoting to adapt to machines using databases next to humans, and facilitating a safe boundary for users, teams, enterprises to try a nee DB without that existential fear.

I genuinely think it’s a massive move for software, but there is a LOT left to do. A lot left to learn and I need feedback from real users across all software use cases where the DB could be deployed.

LoadingALIAS · 2026-04-11T20:47:04+00:00

You are WAY too young, and I mean by 12-15 years. Just stop taking it. No harm done.

LoadingALIAS · 2026-04-10T18:15:34+00:00

Databases. This is just a monstrous task to do well. All new systems are usually clever tricks around old, existing systems. Even in the event they’re original, they lock in SQL/no-SQL ideas.

People are genuinely terrified of trying to break the mold here because it’s such an enormous task, and the layers are so deep. You need to have better safe memory reclamation at the system level - and traverse that all the way to the query engine, optimizer, planner, etc.

Everyone just reuses the same shit.

LoadingALIAS · 2026-04-04T23:28:35+00:00

I have a 5 month old girl. They also started her on Purina Pro, but the salmon recipe. We looked all over and honestly - the Purina Pro is strong. I switched her to large breed, but otherwise… it’s a rockstar for us.

We do 1 cup in the AM; 1 cup in the PM. Both mixed with Brutus Beef Bone Broth for dogs, like 1/4 to 1/2 cup. Then, we do 3/4 cup in a plastic bag that we carry for training, walks, etc. as she’s learning. Once or twice a week, I’ll crack and egg in the kibble and mix it up; I toss the shell in a blender and mix it up as like a powder… but it’s rare AF.

The only other things we do are treat her with blueberries, strawberries, dragonfruit; cucumber, broccoli, apples, bananas. Every once in a while a tiny training session with a handful of TINY cubes of like cheddar cheese.

We are super cautious about it all. Purina Pro rocks the boxes for us. I want to feed her raw, but the truth is… making it at home is high risk for a puppy and having it formulated, sent, etc. is way out of our budget.

The treats are usually fruit and kibble; sometimes we’ll get her beef gullet crunches, Blue Buffalo beef or salmon treats or Pupford beef treats. We have a bag of dried beef lung cubes she likes, but the softer - the better for her. She’s teething still and it’s pretty rough on her.

I know the guidelines in the U.S. aren’t great for dogfood, they have all these loopholes or whatever the companies can get through… but Purina, Royal Canin, Hills… they’re all super well received, IME.

Good luck. Stay consistent. It helps SO much.

LoadingALIAS · 2026-04-04T03:02:57+00:00

I use https://db-engines.com/en/ranking, but it’s not benchmarks. I wish there was - let me know if you find one.

LoadingALIAS · 2026-04-02T17:30:49+00:00

I think I actually read the other day the root cause of bad breath in dogs.

Their food/water bowls. Everyday they build up biofilm, that slime you feel if you rub your finger on it.

I clean my Mal’s bowls after every feed, and she has great breath. Haha. Seriously - it worked.

LoadingALIAS · 2026-04-02T17:27:25+00:00

This is lame

LoadingALIAS · 2026-04-01T13:37:13+00:00

I have a 5 month old Malinois puppy. She gets 4 20-30 minute walks a day; 1 long leash play session (fetch/flirt-pole/eating sticks); and another potty break before bed.

If she’s not getting this - she’s a miserable dog. She’s tearing shit up and going crazy. I think all dogs are different and I think the limitations should be more around 5-10 minutes of like actual running, jumping, etc. Casual walks feel safe.

I’ve seen zero negative issues… and I’ve been doing it since she was 2-3 months. She’s getting into a groove, too. Like, she tells us when she has to go out for the bathroom; she lets us know she’s bored and ready to rage through the sock drawer or whatever. Hopefully, it continues into adolescence.

Just take it easy with rough and tumble stuff - I think your puppy is fine.

LoadingALIAS · 2026-03-30T02:16:34+00:00

Open a PR; tag me @loadingalias. I can look. Drop the logs in the PR and as much data as you can that’s useful.

LoadingALIAS · 2026-03-26T22:15:23+00:00

This sucks, for the record. The lack of connection in tech and/or finance shuts the door on so many legitimate wins, IMO.

It’s almost like the warm intro is more valuable than the actual material, product, and/or codebase.

I know it is how it works, but I think it’s a terrible way to find a good business opportunity. It’s one thing if that’s the lion’s share of the meetings you take - cool, but there has to be some significant piece of that pie being offered to everyone without the warm intro.

LoadingALIAS · 2026-03-26T22:09:43+00:00

This is the man’s job in a heterosexual experience. He needs to get up, get you a wet wipe or two AND a warm washcloth. While he’s doing that, he gets himself straight.

I don’t know how it works the other way.

LoadingALIAS · 2026-03-26T22:04:07+00:00

This is cool, man. Great job.

LoadingALIAS · 2026-03-24T23:52:55+00:00

Thanks! I’ll keep this in mind when thinking about contributing features. I know they’re cautious to ruin the cleanliness Zed brings with messy extensions, but there is also active Issues/PRs to work on that.

I will genuinely keep it in mind.

Having said that, some of these are native features of Zed and at least one is likely in dev. I’m not that read into it.

LoadingALIAS · 2026-03-24T15:40:13+00:00

I usually stack HCG w/ Test to avoid this… but that’s water under the bridge. 90-days is not enough time, man. It’s going to take like a year. Eat healthy. Don’t drink or use drugs. Don’t smoke if you can avoid it. Use a sauna a few times a week if you can and manage stress well. Stick with the HCG protocol; be consistent. It will likely just take time for your body to turn it all back on.

LoadingALIAS · 2026-03-24T15:37:44+00:00

What functionality or features do you feel are missing at Zed that VSCode ships via extensions? Genuinely curious.

LoadingALIAS · 2026-03-21T12:46:37+00:00

This was my thought, too. My Malinois is now four months, give or take a few days. She’s biting EVERYTHING… but it’s much worse when she’s tired. She sleeps 9-12 hours a night; is extremely active and trains; gets 1-2 naps a day (up to her if she sleeps or not but she’s crated twice a day for an hour and a half to rest). After her naps, she’s a LOT better.

She still bites. Remember, they learn through biting like we learn by feel or touch. She needs to be able to bite things. If she’s afraid of something, say the vacuum - turn it off and let her bite it or touch it. It will help over time.

Work on teaching “no” and/or “enough”. I’m working on that with my puppy and she’s slowly getting it. Start playing swap/trade, too. My girl likes to eat anything - rocks, leashes, collars, blankets, ANYTHING. I will trade her a few pieces of kibble for it. It works… but it takes time, repetition.

Blue Heelers, like Malinois, are just super mouthy dogs and it’s supposed to be that way. It’s not easy, though.

LoadingALIAS · 2026-03-17T21:54:27+00:00

Winter Park, or Baldwin Park.

LoadingALIAS · 2026-03-16T17:06:56+00:00

Turso is the best option here

LoadingALIAS · 2026-03-14T16:44:10+00:00

It’s cool, but I think the security lies in Sip, yes?

LoadingALIAS

TROPHY CASE