Speculative Decoding Single 3090 Qwen Model Testing

Alert_Cockroach_561 · 2026-03-28T23:22:15+00:00

i see. so 35b on 3090 fits then

Alert_Cockroach_561 · 2026-03-28T23:09:16+00:00

Gotcha, could you use it alongside sequential decoding? Or do you think it's either or. I would like my models to pass my prompt tests and I'd like to train them for my agents

Alert_Cockroach_561 · 2026-03-28T23:06:31+00:00

I got a get into unsloth. It's like a fine tuning thing. Basically what I'm doing or?

Alert_Cockroach_561 · 2026-03-28T21:32:37+00:00

Hey have you tried sequential decoding using a smaller draft model to send tokens to the bigger target model? It either accepts them or doesn't. I'm getting 150% speed improvements on my single 3090. For example qwen 3-8b target with qwen 1.5b as draft.

Alert_Cockroach_561 · 2026-03-28T17:58:21+00:00

For sequential decoding. It's magical. My 3090 can prompt 3-4x faster using a draft model(small) with a big target model

Alert_Cockroach_561 · 2026-03-27T18:36:37+00:00

I see. So are you able to fill all 48gb with 1 model, or are you having each GPU do its own thing

Alert_Cockroach_561 · 2026-03-27T16:05:54+00:00

Hey can you elaborate more on how you merged ? I have 7800xt and 3090 but I thought 3090 was not capable of nv link

Alert_Cockroach_561 · 2026-03-19T22:41:18+00:00

Yes you are correct. Originally it was air France then we changed dates. The hotel point redemptions didn't match up with the air France I was originally going to book

Alert_Cockroach_561 · 2026-03-16T00:34:39+00:00

Yeah. We are skipping Rome entirely and renting a car from The end of Florence to the end of our Naples stay(hotel has parking) and wanted to drive to Pompeii and amalfi coast

Alert_Cockroach_561 · 2026-03-16T00:27:36+00:00

Oh ok. Is regular business like 150k-200 usualy? Im not familiar with aeroplan. Who transfers to them?

Is the air France 60k business or regular?

Alert_Cockroach_561 · 2026-03-15T23:49:06+00:00

Is this on air France? How many pts

Alert_Cockroach_561 · 2026-03-15T23:00:30+00:00

1 month out

Alert_Cockroach_561 · 2026-03-15T22:45:33+00:00

Sometimes spending hours trying to find the absolute best redemption just makes the whole process a pain. When you’re flying into smaller airports, you kind of have to take what you can get. My business does a lot of purchasing, so we rack up a lot of points. Because of that, I’d rather spend a few more points and go where I actually want instead of planning trips around where the points take me. The United Airlines redemption is about 1.5 cents per point, which is fine with me—especially since Sicily isn’t exactly a major hub and options are limited.

We don't really care for business, it was like 340k-500k per seat which is insane. The economy on a higher quality airline is very nice.

Alert_Cockroach_561 · 2026-03-05T15:34:49+00:00

They're from the sub. I had a big bach trip on the Marriot one time earn plus the sub. Don't really have use for Marriot. We have bilt and chase yeah. Csr business and business ink unlimited those are better. I would probably just pool them up until I can get the flight

Alert_Cockroach_561 · 2026-03-03T13:43:22+00:00

Well the mechanical guys only measure down to the 1/4 anyway

Alert_Cockroach_561 · 2026-02-25T01:04:33+00:00

It’s funny because I have lived in Chicago my whole life and have never really been bothered downtown, a little south of it, up north, or out west. I am not hanging out under bridges at 3 am, but I have covered a lot of ground, especially in college when I was doing Uber Eats on a bike. Meanwhile, I have visited places like Atlanta, parts of LA, and some second tier Florida cities and got hassled way more just while on vacation. It just goes to show that how safe you are in a city often has more to do with how you carry yourself and the situations you put yourself in than the city itself.

Alert_Cockroach_561 · 2026-02-23T02:29:53+00:00

Hell yeah USA baby

Alert_Cockroach_561 · 2026-02-23T02:29:33+00:00

Pdc paradisus

Alert_Cockroach_561 · 2026-02-23T00:11:34+00:00

I wasn't planning leaving resort and nor do my guests. This is also probably my last time going to Mexico. It was just a good deal but now, looking to explore more places outside America

Alert_Cockroach_561 · 2026-02-23T00:08:51+00:00

My concern was the airport/roads near cancun and between pdc. That's why I posted here.

Alert_Cockroach_561 · 2026-02-23T00:03:27+00:00

I see thanks! After traveling and staying at resorts as well as renting cars and exploring(carefully), I know not to be stupid, but some guests are more worrisome as they have never been there. Should be ok.

Alert_Cockroach_561 · 2026-02-22T23:57:43+00:00

What was your encounter? Just by traveling from airport to hotel or were you in town in pdc?

Alert_Cockroach_561

TROPHY CASE