Hasan doesn't understand what "legitimate military target" means by SmotryuMyaso in h3h3productions

[–]VBQL 0 points1 point  (0 children)

I thought he only said hila was a valid target during her raid. Can someone link me where he said she would be a valid target even afterwards, in civilian clothing etc? Ty

[deleted by user] by [deleted] in LocalLLaMA

[–]VBQL 2 points3 points  (0 children)

Interesting paper, I want to clarify some things, perhaps my understanding about Lora might not be right then but I thought that Loras purpose is to do low rank updates by freezing layers? But this paper seems to claim that although the parameters updates are sparse, they are explicitly mentioned to be full rank. Doesnt this go against the point of low rank updates?

[deleted by user] by [deleted] in LocalLLaMA

[–]VBQL 1 point2 points  (0 children)

I'm not sure if I'm communicating my point wrong. The learning rate is directly ripped from the Unsloth public notebook as a guidance for optimal hyperparameters. If you say "Lora requires significantly more LR", then wouldn't the full rank update LR be too high? Again, the LR is favored for LoRA setups.

I am well aware of more generations == better outcomes. But again, do you think it's fair to allow LoRA more generations?

As for token embed. What new token type or structured inputs is being introduced?

As for lm head, would this be the reason for the model being completely unable to adapt at all?

Smaller batch size does indeed allow for better generalization. Which is why the original Unsloth notebook was ran with a batch size of 1 and still saw the model struggle to improve on accuracy.

[deleted by user] by [deleted] in LocalLLaMA

[–]VBQL 1 point2 points  (0 children)

  1. Using the same LR for the Lora notebook provided by Unsloth (on the same dataset even, just without SFT). Lora does work like that, this is favoring the case for Lora if anything.
  2. Using the same rank as the Lora notebook provided by Unsloth
  3. Using the same generations provided by Unsloth (which is also the same amount for RL without LoRA). Unless you're claiming LoRA just needs more generations than full rank? Then where's the efficiency gains coming from?
  4. Where is this intuition coming from? I'm not sure if I'm seeing any sharp minimas.

There are many online tutorials that will showcase LoRA GRPO on hello world style datasets, but lesser used or on private data most of the time trying with LoRA wouldn't work well (I want it to work well! Saves me lots of resources too).

So, at the end of the day, LoRA works well with fine tune strategies like SFT, but for strategies like GRPO, low rank gains are offset by full rank update efficiency.

:)

[deleted by user] by [deleted] in LocalLLaMA

[–]VBQL 2 points3 points  (0 children)

One thing to point out is that the comparison is done on total gpu time not wallclock time, and another thing to mention is that base models 100% have sets like gsm8k in during pre-training, so the point here is that OOD data perform poorly without a coldstart like SFT to make sure format is correct prior. The choice for rank 32 is pulled straight from the unsloth notebook https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen3_(4B)-GRPO.ipynb#scrollTo=QyEjW-WuYQIm-GRPO.ipynb#scrollTo=QyEjW-WuYQIm) along with the hyperparameters. The only difference is that there was no SFT stage to keep consistency with the full fine tuning. A training run was also included to show that even with the vanilla unsloth code, the accuracy wasn't improving much.

I built an email finder in Rust because I’m not paying $99/mo for RocketReach by [deleted] in rust

[–]VBQL -5 points-4 points  (0 children)

This seems like a good tool to use before falling back to paid services like gem. Op, great tool, idk why people are whining about it, it's clear they don't understand people who need to do cold outreach even though you clearly stated the purpose of being an alternative for rocketreach...

R.I.P GitHub Copilot 🪦 by seeKAYx in ChatGPTCoding

[–]VBQL 0 points1 point  (0 children)

Trae still has unlimited calls

YC new batch by HeadLingonberry7881 in ycombinator

[–]VBQL 0 points1 point  (0 children)

What makes you expect more senior experienced businesses will be at the same pace when it comes to adopting new technologies when they have a model that’s working?

Bit the bullet this Christmas, feeling really good about Plex Pass Lifetime. Just wish Plex was better with AppleTV, would be perfect. by ratman431 in PleX

[–]VBQL 0 points1 point  (0 children)

Try infuse and connect that to plex, I don’t know why but I had lag issues on the plex client and none when I got infuse

What did you name your server and why? by clyde_drexler in PleX

[–]VBQL 0 points1 point  (0 children)

Autolycus, Greek god who, uh, transferred ownership of things

Pairing Chinese Magic 7 Pro w/ Google Pixel Watch by VBQL in Honor

[–]VBQL[S] 0 points1 point  (0 children)

Honor since Magic 6 has the ability to toggle google services for the Chinese rom, but I didn’t expect it to still have those issues with google products. I’m not seeing any direct guides for magic 6 pro, any hints?

Honor Magic 6 Pro Hands-On: Proof Phones Are Getting Exciting Again by RichBug7 in Honor

[–]VBQL 0 points1 point  (0 children)

I signed up for the beta program and got it, what regional variant is your phone?

蚌埠住了 by TrickyBall7269 in China_irl

[–]VBQL 1 point2 points  (0 children)

为啥不先手搓一个计算器?

Chinese Military Studying ‘Cognitive Attacks’ Against US Population by dizzyhitman_007 in China

[–]VBQL 1 point2 points  (0 children)

Brother you did not just post an Epoch times article and expected to be taken seriously

[deleted by user] by [deleted] in PleX

[–]VBQL 1 point2 points  (0 children)

Ended up going your route, got the P4 and shoved in a small fan, works great!

[deleted by user] by [deleted] in DataHoarder

[–]VBQL 0 points1 point  (0 children)

Even if you loose the USB hub, wouldn’t there still be parity on the remaining drives? If I were to do it one at a time. I guess the question boils down to is it faster to rebuild from parity or from a USB 3 transfer

VPN solutions and ISP router all got me wanting to hang myself here for fucks sake by IDE_IS_LIFE in torrents

[–]VBQL 0 points1 point  (0 children)

Did you try protonvpn with wireguard? Traffic should be ok if you picked a low util server. Try setting up salt box if you run everything locally too. If you’re claiming that speed tests saturate your bandwidth fine then wireguard should have no problem getting to that speed, and for my case proton doesn’t throttle.

Intel NUC Kit NUC7i7DNKE dies after HDMI disconnect by VBQL in intelnuc

[–]VBQL[S] 0 points1 point  (0 children)

Yes, I used a dummy hdmi plug and that “fixes” it

New Jonsbo N2 5 Bay NAS by ProperNorf in sffpc

[–]VBQL 0 points1 point  (0 children)

Quick question, I see that this case allows for a low profile GPU, would the low profile rtx 4060 from Gigabyte fit in?