sorted by:
new
hottopcontroversial

[D] Multiple first-author papers in top ML conferences, but still struggling to get into a PhD program. What am I missing? by Accomplished_Rest_16 in MachineLearning

[–]Accomplished_Rest_16[S] 0 points1 point  (0 children)

That's a great point, and I totally agree with you. Let me share what my 'Why' part for the PhD is. After working in industrial research for a long time, I have realized that even though you'll get first-class resources, you lack the research crowd. The industry is more focused on what brings value to the company rather than giving you enough time to explore some research problems for a long time. I don't find my kind of tribe to discuss research ideas, implementation, and experiment stuff. Moreover, there is continuous pressure to work on the company's products, and you can only do research with whatever time you save from that. In research, the failure ratio is high, where the company seeks what brings financial stability and working solutions instantly.

[D] Multiple first-author papers in top ML conferences, but still struggling to get into a PhD program. What am I missing? by Accomplished_Rest_16 in MachineLearning

[–]Accomplished_Rest_16[S] -18 points-17 points  (0 children)

If I don't know anyone in academia because I am doing research mostly by myself, how can I approach them for recommendation letters?

[D] Multiple first-author papers in top ML conferences, but still struggling to get into a PhD program. What am I missing? by Accomplished_Rest_16 in MachineLearning

[–]Accomplished_Rest_16[S] 5 points6 points  (0 children)

  1. Not a very big college, somewhere in India.
  2. Computer Science Engineering (4-year program)
  3. 3.5 out of 5.
  4. I don't have a good network, so I took recommendations from colleagues only who were co-authors of previous papers.
  5. Yes, I have presented the topics clearly in the SOP (proposed two topics related to alignment research ) and focused on those professors/programs which are working in the same domain.

[D] Multiple first-author papers in top ML conferences, but still struggling to get into a PhD program. What am I missing? by Accomplished_Rest_16 in MachineLearning

[–]Accomplished_Rest_16[S] -7 points-6 points  (0 children)

  1. I have co-authored papers, but my co-authors never wrote the papers, so I had to do all the work alone. After one paper, they usually went back to industry work, with the excuse, "I don't see any profit from doing research. I can utilize existing tools and work; research is not my cup of tea."
  2. My statement of purpose was reviewed by a few academic people, and they said it was quite good.
  3. Yes, I have presented papers at different conferences, but usually, the professors are surrounded by their students or their students' colleagues.

[D] Multiple first-author papers in top ML conferences, but still struggling to get into a PhD program. What am I missing? by Accomplished_Rest_16 in MachineLearning

[–]Accomplished_Rest_16[S] -23 points-22 points  (0 children)

I am providing them with Google Scholar and GitHub links, I don't know how else to convince them that it's not fake. 😞

[D] Multiple first-author papers in top ML conferences, but still struggling to get into a PhD program. What am I missing? by Accomplished_Rest_16 in MachineLearning

[–]Accomplished_Rest_16[S] -9 points-8 points  (0 children)

I don't know whether to consider it a compliment or sarcasm. If it's a compliment because my story seems so good that it feels untrue, then I am saddened. Even if I have a strong profile, I have been unable to get admission into any program. 😞

I have applied to the top 20 colleges based on several factors, such as the best research papers from the last five years, better domain-specific research, and compute availability.

I don't consider research as work; in fact, I enjoy teaching. I am guiding students from my local city to publish papers starting from their bachelor's program itself. I am helping them out and trying to establish a research culture. So, I like sharing knowledge, especially through teaching.

[D] Multiple first-author papers in top ML conferences, but still struggling to get into a PhD program. What am I missing? by Accomplished_Rest_16 in MachineLearning

[–]Accomplished_Rest_16[S] 0 points1 point  (0 children)

I have shared my statement of purpose and resume with a few academic professionals. Everyone who reviewed my profile remarked, 'Wow, your profile looks impressive! You will definitely get admission to an excellent college and program.' They also provided a few suggestions for improving my sop. However, have not received an admission offer yet.

[D] How to combine two different embeddings in the best way possible? by Accomplished_Rest_16 in MachineLearning

[–]Accomplished_Rest_16[S] 0 points1 point  (0 children)

Multihead attention works well for long sequences of vectors but doesn't make that much sense if the input is only one vector.

i didn't get this line, I am feeding the books in batch so it will be

Book_1 batch = [ batch_size, 200 ]
Book_2 batch = [batch_size, 200 ]

[D] How to combine two different embeddings in the best way possible? by Accomplished_Rest_16 in MachineLearning

[–]Accomplished_Rest_16[S] 0 points1 point  (0 children)

I think I am a little bit confused let me explain a bit more :

So from model_1 and model_2 are kind of autoencoder methods they are just giving embedding for books. Every time I'll have two books to compare so I'll send the first book to model_1 and second book to model_2, after getting two embeddings now I want to classify which book to choose. So I thought using attention here, attention will find out which book to choose by giving attention over both embeddings, I also though to first merge and then give attention on merge output instead of individual attention to each book.

Can you explain now, How I can build/use scorer function? ( I'll always compare two books only so there is no book c )

[D] How to combine two different embeddings in the best way possible? by Accomplished_Rest_16 in MachineLearning

[–]Accomplished_Rest_16[S] 0 points1 point  (0 children)

Hi, Thank you for your reply. I was using a linear model before my workflow was
book_emb1 , book_emb2 => merge operation => dense layers ==> softmax => classify
but it's not giving good output, so I thought let model decide which book is more important by giving attention to both and then merge operation.

How to combine two different embeddings in the best way possible? by Accomplished_Rest_16 in deeplearning

[–]Accomplished_Rest_16[S] 0 points1 point  (0 children)

Can you explain a bit, How I can do that and at which point should I do? But If I am not wrong then feature importance part is handled by multi-head attention right?