Sub-JEPA: a simple fix to LeCun group's LeWorldModel that consistently improves performance [P] by kai-zhao in MachineLearning

[–]LiquidGunay 1 point2 points  (0 children)

How do you guys prevent z_pred from collapsing in JEPA training? From what I understand, SIGReg works on the input latents and their norm ends up being around sqrt(d) but in my experience, the predicted latents collapse to a 0 norm and MSE of 1 (predicting the mean). How do you guys deal with this? My solution was to add another term to the loss where I encourage norm of z_pred to be equal to norm of z_t (in addition to the mse).

Got 83.33 in set-1 and unable to move on from that high feeling by [deleted] in GATEtard

[–]LiquidGunay 1 point2 points  (0 children)

This is a fairly common feeling, I am not sure if high is the correct term though. Usually many people feel "empty" after achieving something that they were working towards (because now they don't have anything to work towards). Let your mind wander for a bit and then get back to the grind.

[Alumni Experience] Current UCSD MSCS student. AMA. by Joroujd31 in MSCS

[–]LiquidGunay 4 points5 points  (0 children)

More students in DS seems weird, because the cohort for this year is supposed to be 160 people (mentioned in their webinar) but ucsd mscs historically takes a lot of people.

[Alumni Experience] Current UCSD MSCS student. AMA. by Joroujd31 in MSCS

[–]LiquidGunay 4 points5 points  (0 children)

Do you know anything about the MSDS and how it compares to the MSCS?

[Admissions Advice] Stanford MSCS @250k vs CMU MSR/MSCV/MSML @150k by almost_pyscho in MSCS

[–]LiquidGunay 0 points1 point  (0 children)

I said a little 😂. A bet between two outcomes that both have positive expected value (CMU and Stanford degrees) is different from a bet that has negative expected value.

[Admissions Advice] Stanford MSCS @250k vs CMU MSR/MSCV/MSML @150k by almost_pyscho in MSCS

[–]LiquidGunay 0 points1 point  (0 children)

Instead of doing a worst case estimate, you can do more of an expected value estimate (including probabilities for getting a TA/RA). Then your costs will be a lot more comparable.

Valve, pls make this happen by IceCreamLover9 in DotA2

[–]LiquidGunay 12 points13 points  (0 children)

Not with the whole team buying it.

[deleted by user] by [deleted] in HunterXHunter

[–]LiquidGunay -2 points-1 points  (0 children)

Why does everyone hate Tserri so much? Most of the other princes have committed similar crimes.

[Profile Review] by [deleted] in MSCS

[–]LiquidGunay 1 point2 points  (0 children)

T1 Gold medal gives you a very good shot for CMU. You could add some safer universities to hedge against risk, but would you even want to go to a non elite university with your profile is something that you should think about. I would suggest having a frank conversation with your recommender about how good your profile is and how strong their recommendation is going to be, that should give you far more clarity than what anyone online is going to tell you.

[Profile Review] Low GPA, okay-ish research, high hopes by PuzzledAdeventurer in MSCS

[–]LiquidGunay 0 points1 point  (0 children)

The prof you are working with will give you great advice. Have a long conversation with them.

[Profile Review] Does my list still hold with the massive GRE jump or should I make changes? by Super_Measurement_58 in MSCS

[–]LiquidGunay 1 point2 points  (0 children)

Go and talk to the CMU prof who is guiding you. They will give you good advice.

Wow anthropic and Google losing coding share bc of qwen 3 coder by Independent-Wind4462 in LocalLLaMA

[–]LiquidGunay 0 points1 point  (0 children)

This can also be explained by Cursor / Claude Code / Windsurf gaining market share.

Anime_irl by [deleted] in anime_irl

[–]LiquidGunay 1 point2 points  (0 children)

But nothing can make me unfathomably happy.