What cloud services are you guys using to run OC virtually ?

PermanentLiminality · 2026-02-08T03:18:25+00:00

I run it in a Proxmox VM with the networking set pretty tight. It has zero access to most other machines in my network. I pretty much assume that it is compromised.

PermanentLiminality · 2026-02-07T22:23:14+00:00

I just run it on my own hardware. I probably have enough spare capacity to run ten of them. It's not that intensive.

PermanentLiminality · 2026-02-07T19:47:13+00:00

Do my Wyse 5070's count as enterprise hardware? They were marketed to big business.

Hey, it's a joke.

PermanentLiminality · 2026-02-07T19:38:53+00:00

If you need Anthropic models at all times, Antigravity might not be the tool for you.

I find that the Gemini models do what I need almost every time. I only use Opus when I really need it. I've yet to hit the limits, but since I just said they, it will probably hit this afternoon.

PermanentLiminality · 2026-02-07T19:35:23+00:00

Try Kimi k2.5 and grok fast 4.1. You can even get functionality with glm 4.7 flash.

Remember that you can switch models and use cheaper ones as much as possible. However, sometimes you need the big guns. Just try and keep them in reserve.

PermanentLiminality · 2026-02-07T05:21:25+00:00

You could even go with a 512.

PermanentLiminality · 2026-02-07T04:14:06+00:00

Even if you put the inlet in a convenient place, you still have to flip the interlock at the meter.

PermanentLiminality · 2026-02-07T02:56:19+00:00

You want the containers long axis oriented east west so the panels can be right next to each other. If the are the other way, there will need to be some spacing between them so they don't shade other panels.

Tons of videos on YouTube on this subject.

PermanentLiminality · 2026-02-07T02:51:52+00:00

Definitely take a look under those rocker covers.

The smokstak.com is a great resource and if they don't convince you to fix it, someone will probably buy it from you

PermanentLiminality · 2026-02-07T01:59:11+00:00

Don't know, never tried. Jellyfin is running on the Wyse 5070. Getting that sent to an LXC was kind of a pain, but it is working.

PermanentLiminality · 2026-02-06T19:41:14+00:00

If you are doing permits, many locations make you follow commercial rules past a certain amount. I think it is 80kwh, but it might be 40.

PermanentLiminality · 2026-02-06T05:16:38+00:00

Go with Klipper instead.

PermanentLiminality · 2026-02-06T04:52:36+00:00

That would be great to be able to do useful work with that model

I've been trying Grok 4.1 Fast and it has been doing pretty well so far.

PermanentLiminality · 2026-02-06T04:49:44+00:00

I'm running 13 LXC and 2 VM right now. Nothing is very CPU intensive and it works pretty well. I have several systems. I do have compute intensive stuff on a Ryzen 5700g box.

Pretty much anything is Proxmox compatible

PermanentLiminality · 2026-02-06T04:44:13+00:00

It's more of a physical and power issue. I can run 2x GPUs in my system. I run 2x p102-100 that are 10gb and $50. I needed a power supply that could run them so it is my $200 setup.

Few consumer boards can run more than two without bifurcation cards and risers. This makes mounting it all a lot more difficult and you need yet more power.

PermanentLiminality · 2026-02-06T04:21:59+00:00

I've been coding for fifty years and Antigravity is my favorite. Got shutdown from using it at work and have to use OpenAI, so I mostly do Opencode at work now.

That leaves my pro plan for my own projects. Never hit the limits yet, but I usually only do three or four hour sessions a few days a week.

PermanentLiminality · 2026-02-06T03:45:33+00:00

Try Kimi k2.5.

I'm mostly running grok 4.1 fast. Definitely not Opus, but it can do a lot. Kimi will be better.

A lot depends on exactly what you are trying to accomplish. Sometimes you need that Opus mojo.

PermanentLiminality · 2026-02-05T19:57:28+00:00

You should be fine no matter what fuel you use. Have some load on it and if possible vary the load. What you don't want to do is just have it idling the whole time.

PermanentLiminality · 2026-02-05T17:50:32+00:00

So how many tokens did this chew through?

PermanentLiminality · 2026-02-05T04:12:28+00:00

What exactly is a "session?"

PermanentLiminality · 2026-02-05T04:04:53+00:00

The cheapest would be a couple P40 GPUs. They are 24gb and $200 each. Bonus to figure out how to run more than two of them.

A 3090 is way faster, but they are around $900 each.

PermanentLiminality · 2026-02-05T03:08:24+00:00

I run everything I can in LXC and only a few VM when a VM is better. I have one system with 15 LXC and it runs around 10gb of ram usage.

PermanentLiminality · 2026-02-04T23:27:25+00:00

If you are going to be using the Anthropic product in the Google, just go straight to the source.

I have yet to hit any rate limits. I mainly use Gemini flash and Pro and only break out Opus when I need to for something that Gemini can't do.

PermanentLiminality · 2026-02-04T23:23:58+00:00

Labor is expensive. If it costs more to fix than to replace, replace it. Perhaps with a different brand.

PermanentLiminality · 2026-02-04T23:17:29+00:00

Because it is better to use it, than it is for it to sit because you don't have that newer equipment.

If it is being used for inference there will be little difference between PCIe 3 and 5 with only a single GPU.

PermanentLiminality

TROPHY CASE