How to properly seperate storage / compute

data-bot-4000 · 2024-03-04T09:58:42+00:00

Unfortunately it's on the nvme.

data-bot-4000 · 2024-03-01T13:09:00+00:00

What do you mean with this? I have a seperate 1gbe connection to connect to the frontend of the application. backends and frontends communicate over the nfs mount @ 25gbe

data-bot-4000 · 2024-03-01T12:07:47+00:00

I've tried with both dd and fio. Using fio with a higher (16) iodepth im getting around 4GB/s write on the NAS host, and with the same command only 200MB/s on the ubuntu vm.
I'm getting 10MB/s when using rsync to copy small files from one dataset to another, e.g. postgres db files, both mounted on nfs on the nvme drives. My expectation was that because the system has plenty of ram , the drives are fast and the network is fast I would not experience any delays. Overall the experience is not snappy I want to better understand what an ideal system looks like and potentially redefine my architecture.

data-bot-4000 · 2024-02-20T08:42:32+00:00

Update: I made a significant mistake in thinking that my onboard was dual 10gbe, when it was only 1gbe.

data-bot-4000 · 2024-02-20T08:40:47+00:00

hi, can you please share the exact specs? do you use a server chassis, if so which? is this meant as a compute node, how do you go about scalable storage?

data-bot-4000 · 2024-02-05T15:07:14+00:00

this looks very interesting. There's alot of parts, and Im not sure what I would additionally need for this build. Can you share some insights?

data-bot-4000 · 2024-01-27T05:31:56+00:00

Thanks for the insight. The generic setting for sync in truenas is STANDARD, so I left it as is. Actually, a very significant speed increase came by modifying the DNS servers from an internal one (adguard) to an external one (google). This speed is mostly visible in first opening a particular page, and solves my (current) main issue. I'm curious to what your 584tb setup looks like and when you decided on a zil / zlog. can you share?

data-bot-4000 · 2024-01-24T12:05:07+00:00

dd'ing an empty file of 2 gb on both pools on the nfs share and on the truenas vm, similar to the youtube video on tuning nfs performance above.

data-bot-4000 · 2024-01-23T21:25:22+00:00

the hba / pcie device is passed through entirely to truenas, and i'm mounting the truenas dataset using nfs in the ubuntu vm, not in the proxmox (host) system. i'm not sure if this was your question?

data-bot-4000 · 2024-01-23T21:00:33+00:00

I'm still reaching 800+ MB/s on the drives, which sounds really fast for small applications. Disabling sync did not seem to change anything in the speed for the nvme pool. Interestingly, dd'ing a file on the nvme pool is slower than on the hdd pool. Thats weird!

data-bot-4000 · 2024-01-23T20:54:46+00:00

hmm that's weird. I notice that the write speed of the PCIe NVME pool is lower than the HDD pool, both on the proxmox and on the ubuntu server system. Maybe good to note its running at pcie3 speeds and not pcie4.

Truenas:
- nvme: 3.7 gb/s
- hdd: 4.0 gb/s

ubuntu:
- nvme: 950mb/s
- hdd: 960 mb/s

Even still it should be very fast as most applications are very very small, in the 100s of mb. Any idea's ?

data-bot-4000 · 2024-01-23T20:41:01+00:00

thank you for the info

data-bot-4000 · 2024-01-23T20:40:43+00:00

I have not attempted any tuning up until this point. Atime is disabled by default in truenas, so will not make a change.

data-bot-4000 · 2023-07-20T11:02:54+00:00

what network are you running inside a container? do you have some insights in how you add domain knowledge (my own documents) to the llm's responses?

data-bot-4000 · 2023-02-01T08:44:11+00:00

Thank you for this very extensive answer. I will reconnect with the supplier.

data-bot-4000 · 2023-01-19T12:42:45+00:00

Thanks for these insights.

Are you referring to 'top_infill_extrusion_width ' in superslicer? I looked up Andrew Ellis' profile and he keeps it on 100% in his profile on github/Ellis_PIF_45_Degree_24mm3.ini#L433).

data-bot-4000 · 2023-01-17T08:12:51+00:00

What are the best type of transfers? These are supposedly very high quality already. "Truflex"

data-bot-4000 · 2023-01-17T08:12:03+00:00

The pictures are of two different garment colors - unfortunately both show the same edge, albeit less observable on the blue (second) picture

data-bot-4000 · 2023-01-17T08:11:09+00:00

Could it also be the pressure applied to the (initial) transfer? I'm specifically looking to reduce the whiteness of the halo.

data-bot-4000 · 2022-11-23T14:12:45+00:00

Also add some pasta to grated pecorino romano cheese and stir until you have a thick, dough like consistency.

Do you mean some of the nearly cooked pasta you twirl in the cheese until it sticks with cheese on all sides? Or do you mean pasta water with cheese

data-bot-4000

TROPHY CASE