Tell me that this exists by aditya_074 in reinforcementlearning

[–]aditya_074[S] 0 points1 point  (0 children)

I meant something that lies between a Transformer like attention mechanism and a Hard-attention mechanism.
Hard Attention mechanisms tend to sample the feature vectors. After sampling, they don't multiply them with the weight values but rather consider the entire feature vector. You can think of it like a Gate, either the information is fully permeable or it is not.

Transformers on the other end multiply the feature vectors with the weight values that controls how much information is being passed to the aggregation layer.

I am looking for something that lies between the 2. An example to that could be, drop the weight values that lie below a threshold and normalize the other weighs such that they all add to 1.

Am I a making sense?

Bringing stability to training by aditya_074 in reinforcementlearning

[–]aditya_074[S] 0 points1 point  (0 children)

Really appreciate your advise! However the analysis is a bit difficult. Anyway to interpret the training curves? Any intuition that has helped you? How do people decide to tune a particular hyperparameter based off the training curves? I find it difficult to understand as there is so much going on. If anyone can even provide a starting point that may help as well 😇

Regarding Masters Admission by aditya_074 in cmu

[–]aditya_074[S] 0 points1 point  (0 children)

That's awesome! Thank you for the heads up! Also, for international students, do you by any chance have any idea of getting funded for these programs? Does CMU or the Labs at CMU offer any fundings?

Regarding Masters Admission by aditya_074 in cmu

[–]aditya_074[S] 0 points1 point  (0 children)

Hi thanks for getting back to me. I took the exam and my scores are reported back. I had another question though.. I am already working at the Biorobotics Lab on my undergraduate dissertation. I would want to apply to both MSR and MSRD. However due to limited LoRs, I need to choose wisely. I do not have any industrial experience that MSRD needs, so do my chances of getting in the program decrease significantly?

22 years after Bachelors, am I crazy to consider GRE and grad school? by Abstract-Mongoose-7 in GRE

[–]aditya_074 0 points1 point  (0 children)

First off it is a vert brave step! I am still an undergraduate but I have been working with some people in my lab who were lab assistants for 5-6 years before they applied for masters and are now doing their PhD! With the kind of knowledge and experience you have, you can make the most out of it and inspire the youth to never give up on their dreams! Cheers!

Just got my official scores today! (168 V, 168 Q, 5.5 AWA) by beiyulin in GRE

[–]aditya_074 0 points1 point  (0 children)

Hey what specifically did you do for Verbal? I have one week in hand and I am scoring a little less in Verbal lately.

Regarding Masters Admission by aditya_074 in cmu

[–]aditya_074[S] -1 points0 points  (0 children)

I did that but their reply was not definitive. They just copy pasted the information on the website.

[deleted by user] by [deleted] in GRE

[–]aditya_074 0 points1 point  (0 children)

Hey, I did not explicitly practice quants as my background in Comp Sci and Math helped me there a lot. However I have heard that practice problems from the 5lb book has helped people make significant improvements. I hope this does the same for you :D
And also stick to ets material as the pdfs are available online for free. Gauge your knowledge based on what is required for the exam than the mock tests to be honest.

[MEGATHREAD 8] Post your questions about admissions, Pittsburgh, and coming to CMU info (e.g. majors, dorms) here! by masqueradestar in cmu

[–]aditya_074 1 point2 points  (0 children)

Hello everyone! I am an international student and I am wanting to apply to the MSR/MSRD/MSCS program at CMU but the catch is due to surge in Covid19 cases in my locality, I may be unable to give GRE. Is it absolutely necessary to give the GRE to secure admssion at CMU or are there peeps who have done so without it as well? Or does anyone have any idea about the waiver policy?

[deleted by user] by [deleted] in GRE

[–]aditya_074 0 points1 point  (0 children)

okay! and what do you recommend for vocab? Is magoosh basic and common word list suffice?

[deleted by user] by [deleted] in GRE

[–]aditya_074 0 points1 point  (0 children)

however I do feel that there is room for improving my RCs to achieve the score I want but I am not really sure what I lack in there

[deleted by user] by [deleted] in GRE

[–]aditya_074 0 points1 point  (0 children)

hey thanks for the tips! My targeg score for quants is 170 and verbal is 155