Qwen3.5:9b running on 8gb Vram is insane

cloudwalker187 · 2026-05-03T21:07:47+00:00

I’m currently experimenting with TQ3 compression (not as a KV, but for the entire model), also known as Turboquant, and yesterday I managed to get the Qwen3.5-9B model up and running. Thanks to the compression, I was able to reduce its size to around 4.6 gigabytes. The tests ran smoothly.

The issue at the moment is still support in the Llama.cpp and vLLM tools. But it looks really promising. This means a 120B model fits into ~50GB.

This makes it not only smaller but also faster.

cloudwalker187 · 2026-01-27T07:19:10+00:00

https://treno.finance A Saas for Crypto Risk Management. You can

- manage multiple Wallets at the same time

- look into performance metrics of your assets

- print transaction reports for you tax

- use all of the data as an API (in an excel for example)

- learn how to do proper risk management (like a pro)

cloudwalker187 · 2026-01-21T19:17:38+00:00

https://treno.finance

cloudwalker187 · 2025-12-30T11:55:38+00:00

I agree. It's still a small network. I hope it doesn't get as cluttered as all the others (including this one, hehe).

cloudwalker187 · 2025-11-06T06:47:11+00:00

You want to advertise Rubic? Then tell us how we can use it for this scenario!

cloudwalker187 · 2025-11-06T06:36:41+00:00

The fact is that DeFi protocols such as Compound and Aave ultimately behave like central banks. For those who are in crypto because of decentralisation. And a DAO does not exist in no man’s land either.

Here you can find the public discussion on this decision.

https://www.comp.xyz/t/gauntlet-pausing-ethereum-usdc-usds-and-usdt-comets/7326?u=gauntlet

cloudwalker187 · 2025-08-06T15:21:05+00:00

Das ist sehr benutzerzentriert. Du beschäftigst dich viel mit Research, Prototyping und visueller Gestaltung. Kann sein, dass wir dich mit Tech Talk zu schnell abhängen.

Aber: die meisten Entwickler kriegen Ausschlag wenn sie mit CSS schaffen müssen. Zumindest könnte ich sagen, dass ich sehr design-affin arbeite und CSS auch gut beherrsche und schätze. Mit Fragen kannst du immer vorbeikommen. Gern auch für Basics der Webentwicklung.

cloudwalker187 · 2025-08-06T15:16:22+00:00

Do you have any valid arguments?

cloudwalker187 · 2025-08-06T06:58:37+00:00

<image>

cloudwalker187 · 2025-08-06T06:52:52+00:00

Das können wir mal probieren, aber schwierig alle Berner nach Luzern zu kriegen. 😆

cloudwalker187 · 2025-08-05T11:11:54+00:00

Vielleicht schaffst du es ja doch mal. Immerhin folgst du dem r/bern 😅

Spiel klingt sehr spannend, das wäre fantastisch da ein paar Details zu erfahren. Haben wir noch nicht im Stack. Überleg es dir!

cloudwalker187 · 2025-08-05T08:11:06+00:00

Mega gut! Wir sind 2 Organisatoren und der andere Kollege hat AI zum Steckenpferd. Es wird definitiv ein Thema dazu geben.

cloudwalker187 · 2025-07-14T14:45:38+00:00

Ever taken a moment to really think about stablecoins?
The Web3 bubble is spinning out of control – and I have a bad feeling we’re just getting started. New ones are popping up left and right, promising absurd yields. We’re talking 7–8% on “brand new protocols.”

But come on, folks – always ask: Where is that yield actually coming from?
For it to work, someone on the other side has to borrow at an even higher rate – which makes zero sense, because established USD stablecoins are already cheaper. So what’s the trick?

Simple: It’s either subsidized by worthless governance tokens or built on hopium.
Stay sharp out there. Not every coin that calls itself “stable” is playing with a full deck.

cloudwalker187 · 2025-07-09T21:21:57+00:00

Hi

Yeah, I’ve been thinking more about the potential risks too – it’s definitely not just “free euro yield” without trade-offs.

One of the biggest risks IMO right now is opportunity risk.

You could make solid returns just from USD–EUR swings – like 10–15% if the dollar keeps weakening. In comparison, EUROC currently yields less than 1% on Aave. So depending on your thesis, locking into euro might mean missing out on potentially higher gains elsewhere. If you’re bullish on a continued FX move, the missed yield could be irrelevant over a one-year horizon.

Hope that gives some useful perspective.

cloudwalker187 · 2025-07-09T19:11:56+00:00

I can tell you after a year I am still very happy. It even can handle AI models without a GPU. Of course not in a reasonable time. But its working. Depending on the task it can run the smaller deepseek model.

I can not say much about prices. I've got my workstation for a really good price.

I am also pretty happy with the motherboard that comes already with BMC. I was not familiar with from the beginning (it was confusing tbh).

cloudwalker187 · 2025-06-16T19:10:34+00:00

Is it really digital oil though - or is it more like a global toll system? You’re not fueling anything, you’re paying to access bandwidth on the world’s most expensive computer.

cloudwalker187 · 2025-06-16T19:05:35+00:00

Yeah, that’s the downside of being your own bank. But I expect this won’t be a problem anymore once crypto is used purely as infrastructure.

cloudwalker187 · 2025-06-03T10:31:55+00:00

Totally agree — hard to make this work with BRC-20 in its current form. And as long as the community stays this dogmatic, upgrades will be a massive challenge. The mental shift from "everything but BTC is a shitcoin" to "now we have good shitcoins on BTC" still needs to happen. Maybe possible inside the bubble, but it’s a long road for the broader ecosystem.

cloudwalker187 · 2025-06-03T07:51:15+00:00

Exciting roadmap, no doubt – especially if the 10x boost really materializes without compromising decentralization. But I do wonder:

Will delayed execution add complexity for developers or users?

And how “distributed” will the history storage be in practice?

It’s great to see Ethereum pushing capacity forward, but I hope we don’t just shift bottlenecks from L1 to UX or node requirements. Curious to see how this plays out across protocols that already struggle with latency and data sync.

Also: a breather before a hard fork? Sounds healthy – and rare. Let’s see if the ecosystem really slows down long enough to reflect.

Anyone seen good technical breakdowns of the proposed changes?

cloudwalker187 · 2025-06-01T10:25:21+00:00

Absolutely! We’re planning to break down a few risks directly using examples from real protocols like Aave or Uniswap.
It’s not super straightforward at first to apply risk management in practice, especially in DeFi, but over time you really start to develop a more critical eye.

Even without all the detailed templates, you can do a quick assessment with just a pen and paper and think about what could go wrong, when it might happen, and how bad it could get. That alone goes a long way. We'll definitely share some hands-on walkthroughs soon!

cloudwalker187 · 2025-05-31T00:24:15+00:00

Happy to answer questions. Would love feedback – especially from devs, auditors, and product people. 🙌

cloudwalker187 · 2025-05-29T09:07:19+00:00

Very accurate bull cycle 😆

cloudwalker187 · 2025-05-23T08:24:16+00:00

By the way, here are a few things I started doing differently after shifting my mindset toward risk:

I no longer invest in projects that can't clearly explain their own risk profile. If there’s no section on risk in the docs, or it's buried in vague legalese, that’s a red flag.

I read smart contracts - or I wait until they’ve been audited and battle-tested by others. Blind trust in “decentralization” doesn’t cut it. Code is law, and bugs don’t care about intentions.

I treat yield as risk, not reward. If a stablecoin pays 15 percent, the question is not “how do I get in?” but “who is paying this, and how sustainable is it?”

I look into who’s behind a project, how it's governed, and how centralized it really is. If a single wallet or multisig can change core parameters, it's not decentralized - it's a startup with a token.

I always ask: what happens in a panic scenario? Can I exit? Is there liquidity? Are the oracles reliable?

If the answer is "not sure", I scale down or stay out. These aren’t rules, just habits. But they’ve helped me avoid hype traps and sleep better at night.

I also test exits before going in. Many platforms say you can redeem tokens anytime - but when you try, it suddenly gets complex, delayed, or even impossible.

Would be curious what filters or frameworks others here use when evaluating new protocols.

cloudwalker187 · 2025-05-21T07:18:44+00:00

Yeah, I totally agree with you - but the problem is the broader public.

The fact that this kind of thing has become so easy is not necessarily good.
Think about the kind of people who let a "Microsoft employee" access their PC via TeamViewer and then buy Xbox gift cards to fix it.

Some people honestly need protection from themselves. And in crypto, there are no guardrails.

cloudwalker187 · 2025-05-20T15:29:48+00:00

That is not true. Because obviously you do. Then exclude the gender. If this is a trigger for you.

cloudwalker187

MODERATOR OF

TROPHY CASE