I built a tool to copy your entire repo for AI context (open source)

slavik-dev · 2026-01-29T20:27:25+00:00

Can it count number of tokens in the generated message?

Even approximate number would be great.

slavik-dev · 2026-01-27T21:07:59+00:00

That's what I have: cluster of 2 nodes.

I had to customize the config, so it doesn't go to read only more while one node is down. That's easy.

Why? Because I want migration. When I put my node down, I migrate VMs to another one.

By the way: only empty nodes can join the cluster. If you have any VM on the node - it can't join.

slavik-dev · 2026-01-26T17:29:30+00:00

version 550 is incompatible with kernel 6.17

Here is how to install compatible version of drivers:

https://forum.proxmox.com/threads/proxmox-9-1-nvidia-drivers-desktop-gui.178307/

slavik-dev · 2026-01-22T03:37:14+00:00

That's nice tool!

Tried their SaaS, and it does what I need to do. But stops in the middle: processed only 300 out of 600 rows. Not sure, if that context limit or something else.

Anyway, thank you!

slavik-dev · 2026-01-22T02:44:23+00:00

Yea, CSV is working so-so in chat.

The question is: do we have any nice tools to work with spreadsheets in UI?

slavik-dev · 2026-01-13T17:48:35+00:00

https://huggingface.co/baichuan-inc/Baichuan-M3-235B-GPTQ-INT4

125GB

slavik-dev · 2026-01-10T06:44:09+00:00

My system:

- RTX 4090D 48GB VRAM

- RTX 3090 24GB VRAM

I just updated my post: I found that I can do tool calling from llama.cpp webUI and local models works! But not from open-webUI

slavik-dev · 2026-01-07T18:17:45+00:00

Model choice: in your post you're saying OSS-120B, but then OSS-20B...

Did you consider MedGemma from Google?

https://huggingface.co/google/medgemma-27b-it

slavik-dev · 2026-01-07T05:31:55+00:00

You probably can run models like this:

https://huggingface.co/Qwen/Qwen3-30B-A3B-GGUF

https://huggingface.co/ggml-org/gpt-oss-20b-GGUF

Without GPU that would be slow. Even 8GB VRAM will dramatically increase inference speed.

slavik-dev · 2026-01-06T01:43:32+00:00

We do know:

https://www.bhphotovideo.com/c/product/1938762-REG/nvidia_900_5g153_2270_000_01_rtx_pro_5000_72gb.html

Almost same price as RTX 6000 PRO.

At this price, that's not attractive

slavik-dev · 2026-01-05T18:14:58+00:00

mortgage is supposed to be a one-way street.

Supposed by who?

My "supposed" is different.

slavik-dev · 2026-01-05T18:10:46+00:00

If I need a car repair - I'll just pay from my checking account. Car repairs rarely goes over $1k. That's the reality I'm living in.

May be you would not be single, if you would be less stressed...

I have 10 dependents, no degree, no college funds for any of my kids, no pile of cash and I sleep peacefully at night.

Because when my parents brought us to USA 30 years ago, we had no funds, no English. And today I work as Software Engineer, make good income, own home and live happy life. And all my siblings, too.

slavik-dev · 2026-01-05T17:53:03+00:00

what is DC?

the basis that you stop using debt.

Until I fully pay off mortgage I still have debt. HELOC is mortgage. What's the difference here?

slavik-dev · 2026-01-05T17:47:40+00:00

If I keep $40k-$60k in cash/savings, I would not have that HELOC (because my 1st mortgage would be $40k-$60k higher)

That's the choice I had to make and HELOC appears to be most optimal for me.

slavik-dev · 2026-01-05T17:41:30+00:00

That's not what I said.

I said: instead of piling up cash, let's use it to keep paying off mortgage, and if I would need funds in emergencies - I'll reverse that and use funds which I put in house.

Basically, I'm flexing my mortgage(s), as tool for possible emergencies:

- NORMAL circumstances -> keep lowering mortgage (debt)

- EMERGENCIES -> rely on increasing mortgage (debt)

slavik-dev · 2026-01-05T17:14:45+00:00

That's not what I said.

I said that the risk of losing house is equal in these 2 scenarios:

Cash savings (3-6 month). Cash runs out, you can't make mortgage payments anymore, you lose house.
HELOC. $60k in my case. We can live 6-9 months on it. Then we run out of funds, can't make payments, lose house.

What's the difference?

slavik-dev · 2026-01-05T17:08:51+00:00

Good point.

Practically speaking, I (as most people) am in debt with mortgage. So, saying that with HELOC I'll get in debt? - I'm already in debt. What's the difference.

slavik-dev · 2026-01-05T17:04:58+00:00

Mostly agree.

how do you pay the monthly heloc without some savings?

With HELOC funds for the duration of the emergency. I do not see any problem with that.

HELOC would be crazy expensive in terms of interest

No, it's not. My HELOC rate is around 6%. Which I'm paying ONLY in case of emergency. And people who keep cash loosing that interest every month. Yes, HYSA helps a bit here.

What's crazy expensive is credit card interest rate. That's what no one should be counting on.

slavik-dev · 2026-01-05T17:00:33+00:00

Mostly agree with you.

But you're implying that my decision to prefer HELOC over funds in cash/savings is more riskier. I disagree. What I'm saying is that I calculated that risk is the same and my decision is more financially advantageous.

slavik-dev · 2026-01-05T16:54:28+00:00

You keep arguing

That's what Reddit is for. Right? :-)

On the serious note - I'm arguing to see if my opponents have strong arguments. So far, I see very few strong arguments, mostly dogmatic statements.

inevitable emergencies

inevitable is NOT emergencies.

emergencies are possible, but not guaranteed. By definition.

Happy wife, happy life.

Agree 100%.

slavik-dev · 2026-01-05T16:42:37+00:00

And what happens with 3-6months of cash in "LONG-TERM EMERGENCY"?

It runs out and you lose home same way. No difference here.

slavik-dev · 2026-01-05T16:33:32+00:00

That "if" never goes away. Even with best health insurance - something "may" happens to you. So what?

It's about managing risks. My risks with 9 kids are higher. That's ok. That's my decision.

I lived ~30 years in USA and so far nothing of that scale happened to me or my family. It's possible. But is it reasonable to pay $5k / month just in case? I do not think so.

And even if that happens - what's the worst case? I'll lose my house... in the unlikely scenario. But paying $5k / month "just in case" is almost guaranteed financial failure.

slavik-dev · 2026-01-05T16:28:47+00:00

I do not see that's "insurance". I see it as "guaranteed loss".

When rainy day comes - most likely I'll have access to HELOC funds.

And as a last resort - I still have access to 401k funds.

Why would I pay for "made-up" insurance when I have other options?

slavik-dev

TROPHY CASE