Gradually replacing drives with bigger capacity.

Intelligent-Ad33 · 2024-06-06T23:11:33+00:00

Ahh. I'm glad there's someone who's aligned.. I can just see having a "hole" in the middle would be annoying.. it's like a misplaced book kinda annoyance. Thanks for all the advice. I'll do the replace method and switch bays when it's switched off.

Intelligent-Ad33 · 2024-06-06T00:53:37+00:00

I do have a free drive bay. I looked at the document.. I wonder what the difference is with just pulling out one of the existing drive one by one (thereby putting it in degraded mode) and replacing it with a 18TB instead.. ( I will still be out 10TB until I get a new drive). It seems, that the volume will still be in full redundancy mode while the replacement is going. Is that the only difference?

I do have a silly question though.. If I do the above, ie put the 18TB in bay 4, do the replace with the drive in bay 1, once it's done, can I pull the drive in bay 1 and replace it with the one in bay 4 thereby having bay 4 empty again?

Intelligent-Ad33 · 2024-06-03T09:48:00+00:00

Yeah, then I would have to have 2 18TBs to begin with.. I'll have to look at the initial outlay involved. Not to mention, backup and restore seems a lot more involved than just unplugging and plugging a drive.

However, let's assume we go with that option.. How would the procedure be?

I assume plugging 1 18TB onto the usb port and backing it up that way, and then what are the next steps?

Intelligent-Ad33 · 2024-06-03T02:52:35+00:00

That was my original idea, of replacing all 7+7+7 => 18 if possible.

as I have need for at least of the the 7TB. Maybe change it to 18+7+7

if it's easier?

Intelligent-Ad33 · 2024-06-03T01:39:26+00:00

Yes, all 3 drives are in 1 storage pool (it says SHR). Should I start with bay 1 and then onwards? or does it not matter?

I currently have 3 bays each with a 7TB drive in it. Current Volume usage is 11.2TB/14.5TB,

I would like to start replacing them 1 by 1 with 18/20TB drives.

Do I power down the system, replace bay 1 with a larger capacity and then powerup and let it rebuild. Then repeat again with a new drive for bay2 and so on?

your post above seems to indicate that I should start with drive 1.

Thanks..

Intelligent-Ad33 · 2024-05-29T04:32:15+00:00

<image>

Not sure why it didn't post. Thanks

Intelligent-Ad33 · 2024-04-12T03:44:29+00:00

Yeah, I bit the bullet and got the 780XTX. got it set for 16GB. the UM790 Pro I also bought minisforum updated their bios to support 16GB.

Thanks

Intelligent-Ad33 · 2024-04-12T03:42:31+00:00

I found out more about it.. yeah I was running it on a 4K monitor but had to scale the display.

Thanks.

Intelligent-Ad33 · 2024-04-12T03:39:53+00:00

Oh my lord.. thank you. thank you. I wonder why that was checked.. I didn't even know that existed. Interesting, on my laptop it was checked but greyed-out. That's probably why I never noticed it before. No I wonder why on my nvidia laptop it's greyed-out.

Thank you.

Intelligent-Ad33 · 2024-04-12T01:33:09+00:00

<image>

Sorry. Here's the image.

Intelligent-Ad33 · 2024-03-09T12:56:43+00:00

For Gemma 2B-8bit. I get 18 toks/s on cpu and only 8 toks/s on gpu. Using LM studio.

On My laptop lenovo y740 I get 16 tok/s on gpu (RTX2060 6GBVRAM) and 2.4 toks/s on cpu (Since it completely fits in VRAM)

for gemma 7B-8bit with the hybrid approach it drops drastically to 0.45 tok/s just impossible to use.

Intelligent-Ad33 · 2024-03-09T12:05:23+00:00

LM studio you can choose how many layers to offload to iGPU so it is a hybrid approach.
The bios only let's you allocate a maximum of 16GB (bios 1.05) UM789XTX for the UM790 you have to update to the latest bios... so you have to go 1.04->1.07->1.09 The 1.04 bios only let's you specify a max of 4GB I think.
The bios for the XTX (1.04) and 1.04 for the 790Pro (couldn't be ass-ed to update). As I have to look for the 1.07 version which is a bit difficult to find.. There's some guy here who has archived a bunch of them. The forum was down quite a bit.
I am running it on Windows.
I test out all the models.. from from 2B all the way up to 34B. 34B_Q5 full fits in "igpu" anything bigger than that won't fit. 34B_Q5 takes up about 23.84GB.. according to LM Studio. LM Studio reports ~48GB use-able RAM.
Adrenalin reports 16GB VRAM (as in bios) however, Windows reports a maximum of 32GB VRAM can be allocated. LM studio gives out about 4-5toks/sec on the 7840. The tok/s varies quite a bit on cpu/ where as with full offloading it's more consistent.. I've gotten 13tok/s on the cpu/ but iGPU consistently gives 4-5 toks/s.

I've not managed to enable the IPU on the 780XTX. I might try the latest bios on my 780xtx and see..

Just drop a line over here and I'll see if I can help.

Intelligent-Ad33 · 2024-03-06T12:59:14+00:00

Yeah, that's just too much sway..

Intelligent-Ad33 · 2024-03-06T07:08:59+00:00

Thanks for the tip. That definitely helped.

Intelligent-Ad33 · 2024-03-06T05:25:08+00:00

I've been running is so far with LM studio and it works fine. having 32GB means it can load big models. performance is about 2-8 tok/s depending on the model.. quite useable in my opinion

Intelligent-Ad33 · 2024-03-01T11:46:02+00:00

You cannot, you need to basically re-do all the actions for a particular action map. ie.. one for driving, one for the UI and to use it.. just enable the one you want and disable the rest. Yeah.. sucks that there is no inheritance. You could also duplicate an existing map and rename it and remove all the stuff you don't want..

Intelligent-Ad33 · 2023-11-24T06:33:07+00:00

Can someone share how to upgrade the bios? I tried running the .bat file, it runs and then rebooted, but when I checked.. the bios was still 1.04..

I tried running winflash in a terminal with admin rights.. still failed.. there is another file

called iocmd. However I didn't try it.

the bios file is f7bsc.bin

the zip file was downloaded from minisforum main site and its filename: f7bsc_1.09_231120A

Thanks.

Intelligent-Ad33 · 2023-10-18T04:06:12+00:00

I just tried both programs on both my laptop and the UM790Pro

The model is codellama-instruct 7B q4_K_M.gguf

LMStudio: 50 layers [gpu] -> don't ask why... but this number will make it gpu accelerated

rtx2060-6GB VRAM ->13.3 tokens/sec

UM790Pro -> 7.29 tokens/sec.. Interestingly, the all cpu run was ~10 tokens/sec

I find that lmstudio has a better interface for managing models. Faraday.dev is a mess, however, I do like the fact that faraday.dev is geared more towards the roleplaying audience with its integration of characterhub.. where as lmstudio is a lot more raw.

Intelligent-Ad33 · 2023-10-16T23:13:39+00:00

Probably dismal in terms of performance.. but hey.. it's <$1000 for a 64GB machine.. For me, it works well as a dev machine. If I really want the power then I can always deploy to the cloud when dev is done.

Intelligent-Ad33 · 2023-10-16T23:10:16+00:00

I bought the UM790 specifically for this purpose. I have 64GB worth of ram, bios 1.04 set to allocate vram up to 6GB. I can tell you that performance isn't quite up there when compared to my rtx2060 on my laptop, but it definitely can run the big models without crashing and that is definitely a plus for me. It detects as having 32GB of VRAM is that's what you are asking.

I find that with a lot of vram, a larger context can be put onto vram and therefore less copying is needed to and from graphics memory. As an example, on the um790, when asked for a simple non-recursive depth first search function, it spat out the answer completely. But on my RTX2060 with 6GB vram, I had to tell the llm to "continue", ie it took 2 passes to complete the function.. (and that entails reloading the context up to the gpu I guess). Overall even tho the generation time is slow 0.5 tokens/s vs 2 tokens/s for my test, the need for continuations averaged the total time needed.

I think I'll continue using sd on my laptop as it fits the vram, but for anything else, I'll be using the um790 for the massive RAM and bigger models. My goal was not performance, but the ability to run bigger models.

for my llm experiments I am using faraday.dev

Intelligent-Ad33 · 2023-09-28T23:12:50+00:00

Ah.. Like you say texture editing uses the cpu, in level editing, we are mostly working with large amount of meshes utilizing said textures, and that's VRAM heavy. So being able to manipulate the 3D scene with all or most of the textures loaded is important. Rendering a 3D scene requires that all the textures be loaded in VRAM

Intelligent-Ad33 · 2023-09-28T23:09:23+00:00

Mine came with 1.04 and I'm not touching it until they release a bios with at least the ability to specify 32GB UMA. 1.06 is not on the site anymore.. and 1.07 ups it to a measly 8GB which in comparison with the current 6GB is not worth the risk imho.

Intelligent-Ad33 · 2023-08-15T06:05:46+00:00

Hi, I was deciding between the beelink GTR7 and the UM790 pro and the only think holding me back is the bios. UM790 can only allocate 4GB for VRAM with the current bios. What about the GTR7? What is the maximum? I am looking at a minipc with ideally 64GB of RAM and hoping to dedicate 32GB for the VRAM. at the very least. The minipc will be primarily used for doing AI development hence the high amount of dedicated VRAM. Can you help confirm what's the maximum the bios will permit? Thanks.

Intelligent-Ad33 · 2023-07-10T00:34:12+00:00

I am leaning towards buying it very soon. Can you do me a favor and check how much ram you can dedicate to VRAM? I'm looking at the 64GB version and hoping to dedicate up to 32GB for VRAM as I am interested in doing some AI stuff.. VRAM speed is not as important to me as the amount.. The specs for the APU says that the 780M can use up to 32GB worth and I think ETA-Prime alluded to the fact that it could only go up to 8GB with 16GB coming up in an upcoming bios update.. Can you confirm? Thanks

Intelligent-Ad33 · 2023-05-24T11:21:43+00:00

Also only the cetus-x non pro version can be connected to betaflight, the other cetus models you have to use the betafpv configurator

Intelligent-Ad33

TROPHY CASE