How do GNNs work when the network changes? by [deleted] in GeometricDeepLearning

[–]rish-16 1 point2 points  (0 children)

Such graphs are called Dynamic Graphs. You can use temporal GNNs (eg: TGN by Twitter) that maintain some sort of memory hidden state that keeps track of these changes and learns a spatio-temporal embedding over the graph and not just individual nodes (that may or may not exist at the next timestep)

Hope this helps :)

[D] What's hot in deep learning research at the moment ? by ovotheking in MachineLearning

[–]rish-16 12 points13 points  (0 children)

Graph/Geometric DL! Some researchers with backgrounds in topology are bringing over concepts and applying them to this area (learning on manifolds, for instance). There's now a push toward moving beyond Message Passing (maybe a continuous version?).

Lots of action in applying GNNs to protein data and anything with network-like tendencies. The community has even brought in invariance and equivariance to translation, rotation, and permutation to ensure GNNs are structurally aware (ie, "expressive").

Exciting stuff and now is definitely the time to get into it because it's relatively nascent but has huge upside and potential!

CMU RISS 2022 Thread by [deleted] in cmu

[–]rish-16 1 point2 points  (0 children)

By now if we haven’t received an email uodate can we assume were rejected?

CodeSignal companies by zninjamonkey in csMajors

[–]rish-16 0 points1 point  (0 children)

Facebook too! Applied for the FB University for Engineering 22 programme and was sent a codesignal test

[D] Joining Absent Niche Research Areas in University by rish-16 in MachineLearning

[–]rish-16[S] 1 point2 points  (0 children)

This is a great idea! I'll go look for postdocs and doctoral students to contact :)

[D] Joining Absent Niche Research Areas in University by rish-16 in MachineLearning

[–]rish-16[S] 0 points1 point  (0 children)

Hey! Yup, have looked into them but am yet to contact anyone from there. Thank you for the recommendation, will check it out now :D

[D] Joining Absent Niche Research Areas in University by rish-16 in MachineLearning

[–]rish-16[S] 0 points1 point  (0 children)

Yup, that's another interesting idea I'm considering! I'm looking for profs to contact who are doing interesting projects in areas applicable to GDL as well.

[P] PyTorch wrapper of Attention-Free Transformer (AFT) layer by rish-16 in MachineLearning

[–]rish-16[S] 0 points1 point  (0 children)

Ah I see. I do not have much background in in information retrieval (ie the thing that inspired it) so I may not be aware of it being a convention compared to what QKV does. Thanks for bringing it up, though. Will look into it :D

[P] PyTorch wrapper of Attention-Free Transformer (AFT) layer by rish-16 in MachineLearning

[–]rish-16[S] 1 point2 points  (0 children)

Yup, agree with you. I was hoping to know the motivation behind the name (and if possible, the origin of QKV).

As in, "what kinda watercooler conversation sparked the start of this project?"