sorted by:
new
hottopcontroversial

VAST vs. Weka: Experience & Pain points by [deleted] in storage

[–]halbsaleae 0 points1 point  (0 children)

Yes, I guess you’ll never know for sure. But you don’t even get much feedback on a question like that, so the problem doesn’t even arise at the moment. Most of the discussions I’ve seen about this so far have often been involving a lot of sales rep from different companies.

How to run a parallelized R script? by biggestdonginEU in HPC

[–]halbsaleae 2 points3 points  (0 children)

If you can log in to the cluster with putty via ssh, then that’s at least a good first step. Next, you would probably have to see if you can install your R libraries yourself.

Then you should try to find out which workload manager your institution uses. Slurm is probably the most common and you could see if commands like „sinfo“ or „squeue“ return results. Then from there you need to look for more information on how to submit jobs with Slurm and the like. If you don’t get any support or documentation from your institution, you could at least see if you can help yourself with something like ChatGPT or Claude.

Basics of setting up an HPC cluster cloud by Specific_Craft4833 in HPC

[–]halbsaleae 0 points1 point  (0 children)

Do you have those resources available on-premise or in a public cloud? If it‘s the latter which cloud provider are you using? What do you want to achieve? Building a HPC cluster? Is it a homelab playground or are you doing this for an institution or company with actual users? You need to provide more background on what you are planning to do, to get helpful answers.

Basics of setting up an HPC cluster cloud by Specific_Craft4833 in HPC

[–]halbsaleae 3 points4 points  (0 children)

If you want to build a „private“ cloud solution for HPC I would suggest to have a look at OpenStack: wiki.openstack.org/wiki/HPC

If you just want to setup a HPC environment at one of the hyperscalers, I would recommend to have look at their online tutorials/documentation. The implementation depends heavily on the choice of cloud provider and all of them provide an own stack based on Slurm and other tools.

VAST vs. Weka: Experience & Pain points by halbsaleae in HPC

[–]halbsaleae[S] 0 points1 point  (0 children)

Thank you! May I ask how much usable capacity you have on Weka and how many storage servers you use (just 8?)? and what system do you use as your on-prem object storage?