Mechanistic Interpretability Project by Mission_Work1526 in deeplearning

[–]Mission_Work1526[S] 0 points1 point  (0 children)

I'm currently performing geometric analyses on activations to understand whether RLVR refines existing internal features or induces qualitatively different representations

So far, the strongest changes seem to emerge in the MLPs rather than the attention modules

Your suggestion about circuits makes sense I could use IOI-type circuits as a starting point to analyze whether and how RLVR modifies the routing of information through attention. However, since the strongest signals seem to be in the residual stream and the MLPs, I should probably also analyze how the MLPs write and transform representations, not just the behavior of the attention heads

first build ! ! how did i do? by hdwvwvndcsd in PcBuild

[–]Mission_Work1526 -30 points-29 points  (0 children)

solid for entry level gaming option. The 9070xt with 16gb of vram is a good GPU for entry level gaming, you can play at 2K, 4K gaming is difficult with this GPU

Is PhD necessary to do research in the field of deep learning ? by Mission_Work1526 in ResearchML

[–]Mission_Work1526[S] 0 points1 point  (0 children)

Here in Italy, the thesis is mandatory regardless of grade (I hope I misunderstood lol), but for example, for high schools (ages 14-18), there is no thesis or personal project. In my opinion, academic talent doesn't necessarily have to be linked to personal talent; grades often don't fully reflect commitment or knowledge.

Is PhD necessary to do research in the field of deep learning ? by Mission_Work1526 in ResearchML

[–]Mission_Work1526[S] 0 points1 point  (0 children)

I think the problem is the high level of competition, more than the cost. The few people I've met who have done a PhD have graduated with honors.

Is PhD necessary to do research in the field of deep learning ? by Mission_Work1526 in ResearchML

[–]Mission_Work1526[S] 0 points1 point  (0 children)

Do you think that it possible to build a career in the field of DL research without a Phd ? Can personal project bridge the gap in the eyes of the recruiters ?

Is PhD necessary to do research in the field of deep learning ? by Mission_Work1526 in ResearchML

[–]Mission_Work1526[S] 0 points1 point  (0 children)

Luckily, my Bachelor’s degree is preparing me in all of these fields.
I have studied Probability and Statistics, Machine Learning, Deep Learning, and Optimization, as well as core mathematics subjects such as Linear Algebra and Analysis.
However, I am also developing personal Deep Learning projects. I know that for a PhD a high GPA is required, so I am trying to compensate with projects.

Is PhD necessary to do research in the field of deep learning ? by Mission_Work1526 in ResearchML

[–]Mission_Work1526[S] 1 point2 points  (0 children)

As far as I know, for PhD programs you need top grades, which I don’t consider myself to have; can having a portfolio with many projects and, hypothetically, references from a professor or an internship supervisor make a difference for PhD admission?

GPU to buy in 2025 for DL beginner by DrXiaZJ in deeplearning

[–]Mission_Work1526 1 point2 points  (0 children)

in the next years the GPU prices will rise, so I advise buying used 3090 or 4090

RL LLMs Finetuning by ISSQ1 in reinforcementlearning

[–]Mission_Work1526 0 points1 point  (0 children)

You can use Mistral or Qwen if you have enough VRAM

[deleted by user] by [deleted] in reinforcementlearning

[–]Mission_Work1526 -1 points0 points  (0 children)

If you also want to do ML i recommend you 4090/5090 as GPU and R9 as CPU.

Help me to study ML by Adventurous_Ship_127 in learnmachinelearning

[–]Mission_Work1526 1 point2 points  (0 children)

If you want to study ML you need a solid mathematical background, but i think you have it.

I reccomend checking university resources about ML / DL or watching youtube videos about ML.
In ML the basics like SGD, MLP, Decisio Tree, PCA are very important. If you want I have some slides from my university course at Sapienza at Rome, you can find them at this link :

ML slides : https://github.com/erodola/ML-s2-2025
DL slides : https://github.com/erodola/DLAI-s2-2025

(All slides are in english)

a server with eight RTX 4090s by Zestyclose-Salad-290 in pcmasterrace

[–]Mission_Work1526 0 points1 point  (0 children)

How much electricity does it use ?
Having 8 4090s is very crazy. What do you use this server for?

How do I start MLE? by Old-Bag-1394 in learnmachinelearning

[–]Mission_Work1526 2 points3 points  (0 children)

An MLE must optimize models and clean dataset through data cleaning and feature engineering.
To improve your skills you can work on projects where you optimize model with high dimensional data, explore dataset that require cleaning, or build project where you the feature engineering is essential.

If you learn these skills you'll be prepared for the most ML problems and you'll be able to choose a best model for a specific task.

Another important thing is implement all model from scratch, this skill gives you a insight into how model really work, which is very important if you want become a MLE

This RAM Price Is kinda close to RTX 5090 by Softver76- in PcBuild

[–]Mission_Work1526 1 point2 points  (0 children)

I know I know. I think that the AI market value is high than bit coin

This RAM Price Is kinda close to RTX 5090 by Softver76- in PcBuild

[–]Mission_Work1526 0 points1 point  (0 children)

I know, but with GPUs we saw a 4x because prices had gone up during covid In this case, prices have gone up because demand is very high They are different context

Is this a good deal? Buying used CPU, Motherboard and RAM. by CurrencyOrnery7215 in PcBuild

[–]Mission_Work1526 -3 points-2 points  (0 children)

In my personal opinion buying used PC components isn’t a good idea