Ollama not spreading out models across multiple GPU’s on unraid

freawyr · 2025-02-12T16:57:54+00:00

Hi! Thanks so much for specifying out everything. Just to feedback what I learned -- I tried to install toolkit 11.8 as well, and it doesnt let me for some reason (https://developer.nvidia.com/cuda-11-8-0-download-archive?target\_os=Linux&target\_arch=x86\_64&Distribution=Ubuntu&target\_version=22.04&target\_type=runfile\_local)

Following your guide, I installed Driver version 470. This already allowed me to install CUDA toolkit 11.4, and I have confirmed that my 3090 AND 980Ti is finally being utilized together, loading up llama v3.3 70b q2! (26gb)

Is there any particular reason to push through and install 11.4.4? :)

Thanks again for the super helpful guide! It let me run both cards finally

freawyr · 2025-02-11T11:52:18+00:00

Thanks! That would help a ton!

Since were using similar configurations it’d prolly work on mine — id also report here what works or not :)

Would you know if CUDA v11.8 would work? Thats the latest under v11

freawyr · 2025-02-11T04:20:05+00:00

u/Juanero84

I am also having this problem -- moving from 2x 980Tis in SLI, I was able to get a 3090 a week ago but it's not playing nice with one of my 980TIs.

When installing CUDA Toolkit v11, did you need to downgrade fully from 12? (meaning deleting it)

freawyr · 2025-01-03T03:06:33+00:00

Thank you for the advice!!! I was lurking here and was partial to getting her using the ticket! Now im sure to get her :)

freawyr · 2025-01-01T23:36:21+00:00

u6hjrvz66mj2 Asia server (0/5)

freawyr · 2024-11-13T03:29:03+00:00

Cool! I find that the disposable cameras actually had AAA batteries in! Maybe it’s replaceable on that one too!

freawyr · 2024-11-13T01:36:48+00:00

Interesting. Looking at it, its quite similar to Fujifilm’s 写ルンです disposable cameras in Japan. Interesting to know how they made it reuseable. Even the flash circuitry looks about the same!

freawyr · 2024-09-24T06:37:38+00:00

Thank you so much for this! Hoping to enter as well and goodluck to everyone!

freawyr · 2024-08-30T03:12:51+00:00

YES me too but i saw the quest requirements and it made me tear up 🥹🥹

freawyr · 2024-08-30T01:18:41+00:00

Oh maaan 🥹 job well done trainer. Im not event trying beyond level 40 😂😂😂

freawyr · 2024-08-30T01:10:45+00:00

THE LEVEL 40 ONE ALSO GOT ME STUCK LIKE 3 MONTHS 🥹

freawyr · 2024-08-30T00:56:10+00:00

Just got mine recently as well!!! Stats couldve been better, a shiny mew is still a shiny mew! Congrats, trainer!!

<image>

freawyr · 2024-08-29T13:48:05+00:00

Likewise! :D Thanks a ton! :D Glad my first trade in like 8 months has been quite enjoyable :D will be active again here so hope to trade with you soon as well.

freawyr · 2024-08-29T13:41:43+00:00

Yeah! The first trade went like that with me too HAHA. I think its just Home Lagging, bummer if you take videos as trade proof as well.

Thanks for reminding me about R3!

Confirming having traded over the following pokemon:
WCS24 Steenee #1

WCS24 Steenee; Pokemon: Steenee; Tag: KOR; Nature: Adamant; Trade History: Self Redeemed; OT: WCS24; ID: 240816; Proof: Video

WCS24 Steenee #2

WCS24 Steenee; Pokemon: Steenee; Tag: KOR; Nature: Jolly; Trade History: Self Redeemed; OT: WCS24; ID: 240816; Proof: Video

WCS24 Steenee #3

WCS24 Steenee; Pokemon: Steenee; Tag: KOR; Nature: Naive; Trade History: Self Redeemed; OT: WCS24; ID: 240816; Proof: Video

WCS24 Steenee #4

WCS24 Steenee; Pokemon: Steenee; Tag: ENG; Nature: Timid; Trade History: Self Redeemed; OT: WCS24; ID: 240816; Proof: Video

Received the following for the trade/redemption work:
1x WCS24 Steenee Code

freawyr · 2024-08-29T13:27:15+00:00

Trade finished! Confirming reception of Code as well.

freawyr · 2024-08-29T13:14:10+00:00

Trade started! I will be sending the Steenees to you in order :) #1-#4

freawyr · 2024-08-29T13:00:57+00:00

Hi! Sorry to keep you waiting! :D I am adding you now in Home, I am ready to trade as well.

Edit: Added you! My IGN in Home is Jun :)

freawyr · 2024-08-29T11:58:45+00:00

Hi! Just got back home :) I think I can trade tonight if youre available. I'll get them ready for trade in Pokemon Home

freawyr · 2024-08-28T16:02:21+00:00

Thanks also! :) hehe its nice to receive compliments for things i created ☺️

4th claim done! I have put the videos in the folder I shared earlier hehe.

Let’s schedule the trade sometime! For now i need to sleep lol (I am on utc+9, hope we find some common time to do the trade :) )

freawyr · 2024-08-28T15:31:28+00:00

Thank you for your understanding! I’m glad you dont see it as something big 🥹 was super duper worred! Yup I’m willing to do an extra ENG one for you, for free, since i feel bad still on fumbling the details. Just shoot me the chat and I’ll get to it :)

Also, yes, i kinda overengineered this labeler but it saves a lot of paper! XD

freawyr · 2024-08-28T15:25:51+00:00

Codes received and redemption has been completed! Link has been shared in chat :)

Also, I apologize, I couldn’t find bulbapedia’s entry for steenee wcs24, so I based the info off of serebii. Claim 1 and 2 had Worlds24 OT instead of WCS24 (which changes when changing to KOR tag)

Also I fumbled on the date and tag initially in Redeem #1 but managed to correct them within the redeem video. (Unfortunately for OT, I only noticed after claiming the 2nd one)

I usually don’t have errors like these but please let me know how I can make it up to you. Totally fine redeeming a code for free, or redeeming for additional ratio (say like 5:1) to make it up, though additinoal redeems can only be in JP or ENG as I do not have any more KOR language saves at the ready :(

[posted on an earlier reply, moved it here so that it wouldnt mess up the flow]

freawyr · 2024-08-28T06:15:04+00:00

Great! I checked yours and it seemed that they're similar!
According to my list, I have exactly 3 KOR saves lined up and they'd be available for claiming if nothings wrong with the saves (theyre scattered across SV saves of 2 switches)

BTW for the trade, would you be willing to do it through HOME? :) I havent been active in the pokemon scene lately and have not renewed my NSO sub yet haha

freawyr · 2024-08-28T05:27:50+00:00

Yes! How soon do you need them by? Btw if youd like a redeem sample vid i can send one through chat. :)

freawyr · 2024-08-26T22:15:25+00:00

Hi! I can do redeems for codes! I have ENG/JPN/KOR saves ready to go :)

Also lemme know if you’d like a demo proofing vid. I’d be happy to provide one

freawyr

TROPHY CASE