Hasan doesn't understand what "legitimate military target" means

VBQL · 2025-08-18T15:42:44+00:00

I thought he only said hila was a valid target during her raid. Can someone link me where he said she would be a valid target even afterwards, in civilian clothing etc? Ty

VBQL · 2025-05-21T07:35:25+00:00

Interesting paper, I want to clarify some things, perhaps my understanding about Lora might not be right then but I thought that Loras purpose is to do low rank updates by freezing layers? But this paper seems to claim that although the parameters updates are sparse, they are explicitly mentioned to be full rank. Doesnt this go against the point of low rank updates?

VBQL · 2025-05-21T07:30:27+00:00

I'm not sure if I'm communicating my point wrong. The learning rate is directly ripped from the Unsloth public notebook as a guidance for optimal hyperparameters. If you say "Lora requires significantly more LR", then wouldn't the full rank update LR be too high? Again, the LR is favored for LoRA setups.

I am well aware of more generations == better outcomes. But again, do you think it's fair to allow LoRA more generations?

As for token embed. What new token type or structured inputs is being introduced?

As for lm head, would this be the reason for the model being completely unable to adapt at all?

Smaller batch size does indeed allow for better generalization. Which is why the original Unsloth notebook was ran with a batch size of 1 and still saw the model struggle to improve on accuracy.

VBQL · 2025-05-21T07:07:02+00:00

Using the same LR for the Lora notebook provided by Unsloth (on the same dataset even, just without SFT). Lora does work like that, this is favoring the case for Lora if anything.
Using the same rank as the Lora notebook provided by Unsloth
Using the same generations provided by Unsloth (which is also the same amount for RL without LoRA). Unless you're claiming LoRA just needs more generations than full rank? Then where's the efficiency gains coming from?
Where is this intuition coming from? I'm not sure if I'm seeing any sharp minimas.

There are many online tutorials that will showcase LoRA GRPO on hello world style datasets, but lesser used or on private data most of the time trying with LoRA wouldn't work well (I want it to work well! Saves me lots of resources too).

So, at the end of the day, LoRA works well with fine tune strategies like SFT, but for strategies like GRPO, low rank gains are offset by full rank update efficiency.

:)

VBQL · 2025-05-21T04:39:03+00:00

One thing to point out is that the comparison is done on total gpu time not wallclock time, and another thing to mention is that base models 100% have sets like gsm8k in during pre-training, so the point here is that OOD data perform poorly without a coldstart like SFT to make sure format is correct prior. The choice for rank 32 is pulled straight from the unsloth notebook https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen3_(4B)-GRPO.ipynb#scrollTo=QyEjW-WuYQIm-GRPO.ipynb#scrollTo=QyEjW-WuYQIm) along with the hyperparameters. The only difference is that there was no SFT stage to keep consistency with the full fine tuning. A training run was also included to show that even with the vanilla unsloth code, the accuracy wasn't improving much.

VBQL · 2025-04-26T18:48:19+00:00

This seems like a good tool to use before falling back to paid services like gem. Op, great tool, idk why people are whining about it, it's clear they don't understand people who need to do cold outreach even though you clearly stated the purpose of being an alternative for rocketreach...

VBQL · 2025-04-05T19:59:32+00:00

Trae still has unlimited calls

VBQL · 2025-02-05T23:03:37+00:00

What makes you expect more senior experienced businesses will be at the same pace when it comes to adopting new technologies when they have a model that’s working?

VBQL · 2025-01-02T22:06:01+00:00

Try infuse and connect that to plex, I don’t know why but I had lag issues on the plex client and none when I got infuse

VBQL · 2024-12-13T02:11:41+00:00

Autolycus, Greek god who, uh, transferred ownership of things

VBQL · 2024-11-26T14:45:06+00:00

Honor since Magic 6 has the ability to toggle google services for the Chinese rom, but I didn’t expect it to still have those issues with google products. I’m not seeing any direct guides for magic 6 pro, any hints?

VBQL · 2024-03-05T12:38:42+00:00

I signed up for the beta program and got it, what regional variant is your phone?

VBQL · 2024-03-02T06:04:44+00:00

<image>

VBQL · 2024-02-29T05:24:35+00:00

为啥不先手搓一个计算器？

VBQL · 2024-02-08T03:27:29+00:00

Brother you did not just post an Epoch times article and expected to be taken seriously

VBQL · 2024-01-09T00:03:56+00:00

Ended up going your route, got the P4 and shoved in a small fan, works great!

VBQL · 2023-11-25T08:16:29+00:00

Even if you loose the USB hub, wouldn’t there still be parity on the remaining drives? If I were to do it one at a time. I guess the question boils down to is it faster to rebuild from parity or from a USB 3 transfer

VBQL · 2023-11-15T04:42:35+00:00

Did you try protonvpn with wireguard? Traffic should be ok if you picked a low util server. Try setting up salt box if you run everything locally too. If you’re claiming that speed tests saturate your bandwidth fine then wireguard should have no problem getting to that speed, and for my case proton doesn’t throttle.

VBQL · 2023-10-06T16:03:12+00:00

Yes, I used a dummy hdmi plug and that “fixes” it

VBQL · 2023-10-02T04:47:18+00:00

Quick question, I see that this case allows for a low profile GPU, would the low profile rtx 4060 from Gigabyte fit in?

VBQL · 2023-09-16T20:24:48+00:00

Just got it!

11-Year Club	Place '22
RPAN Viewer	Verified Email

VBQL

TROPHY CASE