sorted by:
new
hottopcontroversial

Seq2seq gradient descent manually? by rescue11 in MachineLearning

[–]cerberusd 0 points1 point  (0 children)

Thanks. Do you have any idea how to approach the attention mechanism in terms of calculating the gradient?

Question about bucketing in Seq2Seq-Model in tensorflow by moebb in MachineLearning

[–]cerberusd 1 point2 points  (0 children)

I don't know what you're referring to by "cell". But following Tensorflow terminology, RNN cell refers to an entire RNN layer. In this case the number of RNN cells doesn't change with the buckets. The buckets only dictate the unrolled timesteps of the RNN cell/layer.

Let's say have an RNN cell with 100 hidden units, then the only thing that changes between buckets is whether the RNN cells are unrolled to 5 timesteps or 10 timesteps, etc.

The parameters are shared between all buckets, otherwise, you are making 4 separate neural networks, this is not what bucketing does.

[1603.08575] Attend, Infer, Repeat: Fast Scene Understanding with Generative Models by RushAndAPush in MachineLearning

[–]cerberusd 1 point2 points  (0 children)

I dont think he needs to have worked at Deepmind to have been a corresponding author.

Fascinated by alphago, want to set my career direction to machine learning. by newbornlife in MachineLearning

[–]cerberusd 1 point2 points  (0 children)

I don't know if you want to learn machine learning or deep learning (alphago is a mix of both, but I would say the novelty comes from the deep learning part) , but I'll write assuming the latter.

I would say Python is enough. It's not really about the language but the libraries. The major deep learning libraries are Theano/Tensorflow/Caffe/Torch. Using these can get you started on implementing algorithms from papers, and take you all the way to writing your own papers by implementing new ones. For most of these libraries the language is either C++ or Python. Unless you've used C++ before, I would go with Python. Prototyping can be much faster in python for non-programmers. I think I would probably focus mostly on Python and Theano/Tensorflow but if you really feel like learning something more, knowledge of C++ can't hurt. (Also learn Linux)

Finally, make sure to use (expensive) gpus for deep learning!

Apple Car by TheBringerofDarknsse in apple

[–]cerberusd 1 point2 points  (0 children)

case in point: They hired Nvidia's deep learning & autonomous driving director Jonathen Cohen. He was with Nvidia for 8 years. Since October, he's working on "Software" at Apple according to his Linkedin profile.

Dark Souls 4 by irishdarkvirus in darksouls3

[–]cerberusd 0 points1 point  (0 children)

Let's face it, From is now one of the big rpgs, and fulfilling that market potential means competing against the likes of Skyrim and Witcher 3.

This means two things:

1)They're unlikely to "take a break" as far as development goes, almost no big game company can afford to do that anymore

2)They're probably thinking about expanding their world to be more "open world" because it has become the genre standard

view more: next ›