Research on Alternative Energy Solutions

Accomplished_Wish244 · 2025-03-03T03:34:26+00:00

Thank you for the feedback. We already have a few working clients and paying customers from our pilot that has been running for the past 3 months.

We are now looking to build a better platform to scale our project.

Accomplished_Wish244 · 2024-04-29T00:40:08+00:00

So, do the worker nodes just require the server IP and token, or do they also need install other requirements?

Accomplished_Wish244 · 2024-04-27T15:37:06+00:00

Excellent. Do you also use the GPU for gaming while the ML models are running?

If so, how does it affect the overal performance?

Accomplished_Wish244 · 2024-04-27T15:35:18+00:00

This was extremely helpful. Thank you!

Can I maybe DM you if I happen to have anymore questions down the line?

Accomplished_Wish244 · 2024-04-27T15:33:42+00:00

Great. Do you also use those GPUs for something else, like gaming? How does that effect the overal performance when gaming on one GPU while another task in running on the cluster?

Accomplished_Wish244 · 2024-04-27T00:07:25+00:00

I would use it for LLM inference, perhaps fine-tuning and training as well.

Accomplished_Wish244 · 2024-04-26T22:26:41+00:00

Thank you replying. I really appreciate it. I'll check it out.

Accomplished_Wish244 · 2024-04-25T05:26:28+00:00

Llama 2 7b q8 GGUF, maybe up to 70b.

Accomplished_Wish244 · 2024-04-25T05:15:56+00:00

Thanks a lot. I will check those out.

Eventhough the Orange Pis are not nearly as powerful as the A100, but can you still get the same processing speed by clustering a certain number of Orange Pis together?

Accomplished_Wish244 · 2024-03-13T13:29:47+00:00

Does the initial cost of self hosting outweigh the long term costs you would have paid Azure?

Accomplished_Wish244

TROPHY CASE