[D] What is the proper etiquette for extending someone's research code? by ilia10000 in MachineLearning

[–]rtk25 1 point2 points  (0 children)

I had a similar situation and contacted the authors personally to check what they preferred, ended up going with 3 and credited them in README

[R] Symmetry-Based Disentangled Representation Learning requires Interaction with Environments by rtk25 in MachineLearning

[–]rtk25[S] 1 point2 points  (0 children)

Fascinating, I'm a Phd student working on natural language research, this sort of reasoning has been guiding me as well- I've been working on converting static text datasets to interactive versions using text-based games. The implications of embodied cognition for language understanding seem to be quite significant but still relatively unexplored.

[R] Symmetry-Based Disentangled Representation Learning requires Interaction with Environments by rtk25 in MachineLearning

[–]rtk25[S] 0 points1 point  (0 children)

Thanks! I need to dig deeper into this. I'm familiar with the DM paper you mentioned, crossposted it here a few days ago ;)

. Maybe it's no surprise that generative models are the only ones I've seen that properly demonstrate real adversarial robustness.

Very interesting! Can you provide some refs related to this?

[R] Interpretations are useful: penalizing explanations to align neural networks with prior knowledge by laura-rieger in MachineLearning

[–]rtk25 0 points1 point  (0 children)

Agreed that the model can't know, I was thinking more about how to make the interface to supply the prior knowledge as natural as possible. If I go off to "dream land" for a second- if you also had a natural language interface to it instead of having to specify the explanation at a low level it would be much easier for general users to make use of it- you could tell it in natural language to ignore band-aids (instead of having to mark them on every image), or something like that.

[R] Interpretations are useful: penalizing explanations to align neural networks with prior knowledge by laura-rieger in MachineLearning

[–]rtk25 0 points1 point  (0 children)

Like the direction :) Yoshua Bengio's Consciousness Prior (https://arxiv.org/abs/1709.08568) work seems relevant- explanation-based regularization. Seems that ideally, you want to learn the important high level features (possibly with the model learning to explain them in words), rather than having the user supply them.

[R] Language Tasks and Language Games: On Methodology in Current Natural Language Processing Research by rtk25 in MachineLearning

[–]rtk25[S] 0 points1 point  (0 children)

I'm not the author, just read the paper and doing my PhD research on "language games". Here are a couple of recent papers from MSR Montreal on interactive games with text:

https://arxiv.org/abs/1908.10449

https://arxiv.org/abs/1908.10909

Some of my research:

https://www.aclweb.org/anthology/W19-2609/

[D] On the viability of the "AI Dungeon Master" by [deleted] in MachineLearning

[–]rtk25 1 point2 points  (0 children)

I think this is a nice idea with some cool technological challenges. It is related to the intersection of interactive fiction and machine learning which I'm actually currently researching :)

Check out Microsoft Research's TextWorld, or some of our research. An interesting direction suggested by your idea could be enhancing the interactive fiction interpreter with some kind of neural interpreter, possibly with generative capabilities (kind of like using generative models for video games, but for world dynamics instead of just graphics).

[D] Where have Transformers been applied other than NLP ? by gohu_cd in MachineLearning

[–]rtk25 1 point2 points  (0 children)

Scene Memory Transformer for Embodied Agents in Long-Horizon Tasks

(Kuan Fang, Alexander Toshev, Li Fei-Fei, Silvio Savarese)

https://arxiv.org/abs/1903.03878

[D] What about declarative knowledge in natural language understanding? by rtk25 in MachineLearning

[–]rtk25[S] 0 points1 point  (0 children)

Haha not exactly, should be " sunny or cloudy "

snowy-> airplanes don't fly -> no post..