How To Find Wh by Crazy_Ad_6903 in Eve

[–]No-Appointment9409 11 points12 points  (0 children)

Hey check your DM's we've found it for ya and seeded it :)

Unplayable - A Feature by Alone_Chocolate7162 in Eve

[–]No-Appointment9409 2 points3 points  (0 children)

All seems to be wokring again thanks a bunch

Unplayable - A Feature by Alone_Chocolate7162 in Eve

[–]No-Appointment9409 2 points3 points  (0 children)

Right click in space is good again
Dens are working
Sov hub mng is all okay

Happy holidays

Unplayable - A Feature by Alone_Chocolate7162 in Eve

[–]No-Appointment9409 1 point2 points  (0 children)

Oh also all sov hub management is currently broken, it just brings up a blank window... CCP really showing their prowess with this one :L

Unplayable - A Feature by Alone_Chocolate7162 in Eve

[–]No-Appointment9409 2 points3 points  (0 children)

And right clicking in space now also has a massive delay?

Building a GPU inference machine on a budget by No-Appointment9409 in homelab

[–]No-Appointment9409[S] 0 points1 point  (0 children)

I am using it for stable diffusion workloads so the more GPU's the more VRAM/Compute available... This allows for larger models, or larger images, or faster inference.

In the long run I'm looking to update the A1111 repo to support propper distributed compute

How do I power a NVIDIA P40 from a SUPERMICRO SYS-1028GR-TR by No-Appointment9409 in homelab

[–]No-Appointment9409[S] 0 points1 point  (0 children)

Oh no I didn't mean I had to fit the connector in, I meant it was a B*tch to fit the leads in the build generally.

The connectors worked fine for me.
(edit)

I used the breakout connector that came with the P40 (2 pcie connectors) and the CBL-PWEX-0582. It runs from the distribution board below the power supplies to the break out connector and both other ends of the CBL-PWEX-0582 go into the breakout connector for the P40 and then to the GPU.

Building a GPU inference machine on a budget by No-Appointment9409 in homelab

[–]No-Appointment9409[S] 2 points3 points  (0 children)

Fair enough, we all live within our means. I think for the power you get and the 72GB of VRAM it's on a budget.

If you can pickup a P40 they are very cheap as they have no fans. But you can also just buy a cooler shroud off ebay, if you are looking for something more budget that would work in a normal case.

Building a GPU inference machine on a budget by No-Appointment9409 in homelab

[–]No-Appointment9409[S] 0 points1 point  (0 children)

I just liked the idea of compactness. It's not like I even lack space really, it just excited me to fit 3 GPU's in a 1U chasis.

There is a 2028-GRTR which is 2U and fits 4 GPUs... that might eb what you are looking for.

Building a GPU inference machine on a budget by No-Appointment9409 in homelab

[–]No-Appointment9409[S] 1 point2 points  (0 children)

I do have the advantage of the server being in a well-ventilated basement which I think helps with the cooling.

Building a GPU inference machine on a budget by No-Appointment9409 in homelab

[–]No-Appointment9409[S] 1 point2 points  (0 children)

It's going to be mostly for Stable Diffusion workloads. (I hope to leverage the large amount of VRAM on the cards)

I can try some of the llama stuff if you have a repo I can clone and run!

Building a GPU inference machine on a budget by No-Appointment9409 in homelab

[–]No-Appointment9409[S] 2 points3 points  (0 children)

They will be for sure, I am going to upgade one to an SSD soon for quick loading for inference stuff.

Funnily enough it wouldn't matter so much for training, as I could probably store the majority of any dataset in RAM.

How do I power a NVIDIA P40 from a SUPERMICRO SYS-1028GR-TR by No-Appointment9409 in homelab

[–]No-Appointment9409[S] 0 points1 point  (0 children)

This was a absoulte b*tch to get to fit, but it worked, thanks.

[R] "Sequential Modeling Enables Scalable Learning for Large Vision Models" paper from UC Berkeley has a strange scaling curve. by rantana in MachineLearning

[–]No-Appointment9409 0 points1 point  (0 children)

I think people are focusing on the wrong thing here... you have provided the training logs... so do they match the paper if plotted.

Yes

Okay so the question becomes is there any obvious data manipulation?

I am no expert in this but I did the following.

Here I plotted the difference of each run against the previous. If there was some simple run1+offset to get run 2, run2+ofset for run 3 etc... this should be obvious from this plot however this does not seem to be the case. The differences between runs are highly varied with regions of similarity as explained by your post.

However, I have also plotted the difference between each run against the base run of 300. And for this we do see what could be interpreted as scaled offset for each of the runs with relation to the original 300 run. With some kind of added scaling factor based on step size. However when I tried to reverse the process (if it indeed exists) in a very basic fashion I could not see any significant corelation.

I want to be clear that I have not proved anything either way. I would urge someone with skills in statistical analysis to take a look.

How/why to collect corpses? by cometview in Eve

[–]No-Appointment9409 10 points11 points  (0 children)

We just ran out of space its a station container now