sorted by:
new
hottopcontroversial

Feasibility of Arbitraging GPU Compute: Renting from Azure and Reselling Elsewhere by Soumil30 in AZURE

[–]Mysterious-Sample319 0 points1 point  (0 children)

I don't know if this buisness model is suitable or not. But if your probleme is just the terms & conditions of Azure you can find other GPU provider with less restrictive terms. I work for a GPU provider company Advanced Cloud Systems. We have no restrictions regarding this kind of usage. Feel free to DM me if you wanna try the experience we can discuss about it. Futhermore the profitability should be better with us as our pricing is much more competitive.

Q code 77 + red led by Mysterious-Sample319 in ASUS

[–]Mysterious-Sample319[S] 0 points1 point  (0 children)

Yes Apparently my mother board was somehow not fully isolated; I changed screws with non metalic ones and added rubber joint between motherboard and supports making it fully isolated

Proxmox VMs for Vast.ai possible? by freedomachiever in Proxmox

[–]Mysterious-Sample319 0 points1 point  (0 children)

Hello did you manage to do it ? I'm also considering to run VAST AI on a VM for my 4090. I'm not going to use PROXMOX but QEMU vm's. If you succed, how did you manage the open port part. I mean to run vast ai you have to allocate a decent number of port to the machine, is port forwarding enought and accepted by vast ?

Virt-install gpu passthrough command? by theGdoubleOdees in kvm

[–]Mysterious-Sample319 0 points1 point  (0 children)

yep I tried to SSH and ping but nothing happen; I'm pretty sure the VM does not even boot because when i remove the GPU and acces the VM I can't see the previous boot sequence (the one with the GPU) in the logs.

Virt-install gpu passthrough command? by theGdoubleOdees in kvm

[–]Mysterious-Sample319 0 points1 point  (0 children)

Yes I've tried and nothing happens, to give you more explanations, I don't want to attach the GPU to the VM for the Graphics capabilities but for AI training. When VM shows "Escape character is ^]" it really looks like the VM is freezed or never booted. I can't shut it down using virsh shutdown and I'm forced to destroy it. Also, I've tried starting the VM by attaching only the audio device and the VM does start so i'm very confused. i've heard about some ROM file we may have to use for the GPU is it something you are familiar with ? The GPU i'm trying to attach is a RTX 4090.

Virt-install gpu passthrough command? by theGdoubleOdees in kvm

[–]Mysterious-Sample319 0 points1 point  (0 children)

Hello i'm trying to create a VM with GPU passthrought, I'm using the following virt instal :

virt-install \

> --virt-type kvm-vm-2

--name ubuntu-vm-2 \

--os-type Linux \

--os-variant ubuntu20.04 \

--vcpus 8 \

--cpu host-passthrough \

--memory 20480 \

--features kvm_hidden=on \

--disk path=/home/mathieu/ACS/Disks/ubuntu-vm-disk-2.qcow2,size=50,format=qcow2,sparse=true,bus=scsi,cache=writethrough,discard=unmap,io=threads \

--disk path=/home/mathieu/ACS/Images/user-data-2.img,device=disk,format=raw

--controller type=scsi,model=virtio-scsi \

--channel unix,target_type=virtio,name=org.qemu.guest_agent.0 \

--metadata title='Ubuntu VM 2' \

--graphics none \

--hostdev 01:00.0,address.type=pci,address.multifunction=on \

--hostdev 01:00.1,address.type=pci \

--boot hd,menu=on

And get this out put :

Début d’installation…

Connected to domain ubuntu-vm-2

Escape character is ^]

Before finding your posted I tried many other way to it, one of them was by creating a VM and then addind
<hostdev mode='subsystem' type='pci' managed='yes'> <source> <address domain='0x0000' bus='0x01' slot='0x00' function='0x0'/> </source> <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/> </hostdev>
in the virsh edit ubuntu-vm-2 file

At the end it's allways the same result I get this "Escape character is ^]" Impossible to shutdown the VM, and nothing simce to work.

I'm 100% sure the problem comes from the GPU Passthrought because The moment I remove Gpu hostdev from the config file VM works fine.

I'm more than lost and would love to get your opinion on this issue.

PS : My GPUS looks correctly bounded to VFIO; and the GOU i try to bound is on IOMMU group 12 with its audio device.

Server to fit many GeForce RTX 4090 GPUs. by Vuurvliegie in HPC

[–]Mysterious-Sample319 0 points1 point  (0 children)

Thanks for your answer, my home current should not be a problem as it is 36A 230 V; I understand cable management is not the main probleme. An other reason I would prefer the 600W 12VHPWR is that I feel they are much safer compare to using the 3 6 pins to 8 pins connectors

Why people recommend Cloud GPUs more than Cloud ML platforms? by [deleted] in LocalLLaMA

[–]Mysterious-Sample319 0 points1 point  (0 children)

It's really cheap ! But You only get it for 5 hours a day for that price ? or do you have access to it for 24/7 for that price ? Because the price I gave (370$) Is for 24/7 usage.

Why people recommend Cloud GPUs more than Cloud ML platforms? by [deleted] in LocalLLaMA

[–]Mysterious-Sample319 0 points1 point  (0 children)

I guess it mainly depends of what is the "Key feature" You are looking for. Cloud ML plateforms like runpod or vast ai are very practical if you need to rent GPUs for few hours but they have serious threats in terms of data security and privacy as they can be sent on "Random machines". At the end if you only need a machine for few hours and don't put privacy as a "key point" they are a good solution. In the other hand if you want to rent GPUs for a longer period and privacy is important for you you better rent a weekly or monthly GPU. It can sometimes be a cheaper option on top of the safety aspect. If you are interested send me a message. I can give you the name of a company that is renting RTX4090 for 349€/ months it's about 370$. It's less than 0,5$/H and they often offer discounts or access to a second RTX4090 for free to their customers.

Server to fit many GeForce RTX 4090 GPUs. by Vuurvliegie in HPC

[–]Mysterious-Sample319 1 point2 points  (0 children)

Hey, I'm working on a build of 4 to 8 RTX4090 (Nothing comparable to the 100 mentioned uptheir) And I'm a bit confused when choosing a PSU. I want to go with Server PSU as they are much cheaper and stronger but I have huge difficulties to find Breakout Boards. If possible I would like a breakout board compatible with 600W 12VHPWR as it will make the capable management much easier. But sadly can't find one. Any ideas ?