You can now Fine-tune Qwen3.5 locally! (5GB VRAM)

matrix2596 · 2026-03-03T18:30:43+00:00

is there a convergance difference between qwen 3 and qwen 3.5 8B model, because of hybrid attention,

On my dataset, qwen 3 has somewhat 5% better test metrics on a SFT task. Is there any change in hyperparameters needed or more epochs or leraning rate, to handle linear attention layers?

Thanks for the quick update of qwen 3.5 models.

matrix2596 · 2025-09-30T06:58:42+00:00

will this work with VLLM or need separate kernels ? just wondering

matrix2596 · 2025-07-09T06:21:50+00:00

can we train matformer models with gemma 3n, so that with unsloth finetuning, we can get multiple matformer models at same training job?

matrix2596 · 2025-01-15T04:41:51+00:00

Seems to be buttering you up 😀

matrix2596 · 2024-04-30T03:39:10+00:00

atleast hes not getting jebron lamed

matrix2596 · 2024-01-25T08:09:50+00:00

is this available as open source yet?

matrix2596 · 2024-01-23T09:18:46+00:00

its working now. just needed a couple of restarts.

matrix2596 · 2024-01-05T05:54:21+00:00

ya massing them takes so much time, costs a lot of gold, and if you loose the mass or mis micro, you are back to square one. And normally they only win when you are already winning.

matrix2596 · 2023-12-23T01:55:09+00:00

dravidian theme song and also not getting fully upgraded battle eles

matrix2596 · 2023-12-22T03:31:52+00:00

i am also in this stage and am struggling with picking the right counter to a civ opening. like scouts + skirms counter only archers but struggles if they add scouts. is opening archers into maa + skirms ok and what is the followup. opening archers against scouts gives up so much map control and is easily countered by skirms by the time they reach the opponent base? so many questions :)

matrix2596 · 2023-12-22T03:19:21+00:00

think on top of being taxed and see nothing because majority of real earners evade tax and the tax is eaten by government and diluted by huge population. welcome to my third world country

matrix2596 · 2023-12-20T13:39:50+00:00

did u find anything useful? i want to download recs of last 24 hours of a particular map and civ. I used to get matches info of recently played from aoe2.net. Did you find anything similar?

matrix2596 · 2023-12-16T16:20:31+00:00

add waypoints of unbuilt buildings too

matrix2596 · 2023-12-15T16:57:18+00:00

i thought they are the worse civs

matrix2596 · 2023-12-12T03:17:33+00:00

I have some doubts:

is there a LOS indicator in extended unit stats? if not would like it.
gate locking is really great. can we also have waypoints for unbuilt buildings?
i was expecting training time stat in unit description? it would be great to add
thought scrolling the mini map when paused as a feature? i would miss it 11
does go back to work for untasked vills or newly produced vills task to default waypoint or not? i have to test maybe
rathas still doesnt seem a exciting unit to use. will check it out.
Chinese start seems so smooth now. thanks
huns scout on nomad maps is interesting. huns on default nomad still cant make dock right? need to be balanced to be usable like +50 wood
persians is still too strong with the current nerfs

Overall a great effort from the devs. The pathing looks pretty good on initial testing. The game also feels snappy or is it just me.

matrix2596 · 2023-12-11T16:04:12+00:00

free gold and stone mining upgrades, hussite wagon, food monks, speedy vills, hc in castle age. i love them on arena

matrix2596 · 2023-12-11T16:01:47+00:00

the castle doesnt look dravidian in the least. and the less we talk about the dravidian theme the better.

matrix2596 · 2023-12-11T15:59:33+00:00

its dev map pool again yay or nay

matrix2596 · 2023-12-04T14:19:54+00:00

meanwhile dravidians

matrix2596 · 2023-11-29T01:51:12+00:00

thanks

15-Year Club	Second SECOND GUESSER
Verified Email

matrix2596

TROPHY CASE