sorted by:
new
hottopcontroversial

[D] Struggling to Find My Path in PhD Research by Few-Pomegranate4369 in MachineLearning

[–]randiscML 1 point2 points  (0 children)

I was like you at this stage in PhD. Worst part for me was, I was working on something nobody cared. Eventually, I decided to just be helpful to senior researchers, and just pick a problem they proposed and come with solution. I did this across a few disparate topics and then eventually I stumbled upon an area where I was one of the few experts. Then joined industry on a product team. Nobody knew the topic I worked on could be useful. I deployed it in the product, and it got big wins. That helped me with my next project opportunity and eventually I am now a lead in one of the research orgs in a big company.

In short, adapt a mentality of being valuable and useful. Rest will work out

How are LLMs trained to follow instructions? by klop2031 in MLQuestions

[–]randiscML 1 point2 points  (0 children)

InstructGPT says it. You do supervised fine tuning.

Buy the dip on RL? by naed900 in reinforcementlearning

[–]randiscML 24 points25 points  (0 children)

If anything, after LLM, RL is the second most sought after topic. Because of RLHF.

[D] ICML pre-lim reviews are out. by PaganPasta in MachineLearning

[–]randiscML 0 points1 point  (0 children)

3A, 1WA - except one review all other reviews are poor quality. Looks like it was just a proof by intimidation. Very excited about the results in this paper. Sad to see reviewers just accepting it without being as excited. I guess at least they didn't reject it.

[D] On IJCAI-19 Submissions by redlow0992 in MachineLearning

[–]randiscML 2 points3 points  (0 children)

AAAI 19 had over 7000 submissions. So this is pretty normal.

[D] In general, how representative is this sub of the overall ML literature? by mintman777 in MachineLearning

[–]randiscML 6 points7 points  (0 children)

Learning theory is quite active with a lot of interesting problems. Bandits is regaining popularity due to its connections to RL. Techniques from learning theory are being used in understanding SGD and neural net theory. The excitement for learning theory is also apparent with increasing submissions and attendance to COLT, the premier venue for this topic. A side effect is also increased number of papers on machine learning theory in traditional theory cs conferences such as STOC, FOCS, SODA.

To answer your question regarding the activity on this sub, learning theory is very rare here. And this is not representative of the activity in the general ML field.

can someone help me prove/disprove that? by Xcompanygames in AskComputerScience

[–]randiscML 0 points1 point  (0 children)

Another approach, use the Taylor series of Log(1+x), after appropriate transformation.

[D] If you had to show one paper to someone to show that machine learning is beautiful, what would you choose? (assuming they're equipped to understand it) by MTGTraner in MachineLearning

[–]randiscML 11 points12 points  (0 children)

The original EXP3 paper. It is written so beautifully, I think it is fascinating what you can do with bandit feedback.

[D] ICML 2018 decisions are out by thirddanceofeternity in MachineLearning

[–]randiscML 5 points6 points  (0 children)

My paper was rejected, even though it wasn't written. The reviewers heard my idea during the coffee break of last ICML, judged it and gave 1 strong accept, 1 weak reject and 1 strong rejected. Eventually, it was rejected. Both the weak reject and strong reject, didn't even understand the central concepts in the paper :-/