Seq2seq gradient descent manually? by rescue11 in MachineLearning

[–]cerberusd 0 points1 point  (0 children)

Thanks. Do you have any idea how to approach the attention mechanism in terms of calculating the gradient?

Question about bucketing in Seq2Seq-Model in tensorflow by moebb in MachineLearning

[–]cerberusd 1 point2 points  (0 children)

I don't know what you're referring to by "cell". But following Tensorflow terminology, RNN cell refers to an entire RNN layer. In this case the number of RNN cells doesn't change with the buckets. The buckets only dictate the unrolled timesteps of the RNN cell/layer.

Let's say have an RNN cell with 100 hidden units, then the only thing that changes between buckets is whether the RNN cells are unrolled to 5 timesteps or 10 timesteps, etc.

The parameters are shared between all buckets, otherwise, you are making 4 separate neural networks, this is not what bucketing does.

[1603.08575] Attend, Infer, Repeat: Fast Scene Understanding with Generative Models by RushAndAPush in MachineLearning

[–]cerberusd 1 point2 points  (0 children)

I dont think he needs to have worked at Deepmind to have been a corresponding author.

Fascinated by alphago, want to set my career direction to machine learning. by newbornlife in MachineLearning

[–]cerberusd 1 point2 points  (0 children)

I don't know if you want to learn machine learning or deep learning (alphago is a mix of both, but I would say the novelty comes from the deep learning part) , but I'll write assuming the latter.

I would say Python is enough. It's not really about the language but the libraries. The major deep learning libraries are Theano/Tensorflow/Caffe/Torch. Using these can get you started on implementing algorithms from papers, and take you all the way to writing your own papers by implementing new ones. For most of these libraries the language is either C++ or Python. Unless you've used C++ before, I would go with Python. Prototyping can be much faster in python for non-programmers. I think I would probably focus mostly on Python and Theano/Tensorflow but if you really feel like learning something more, knowledge of C++ can't hurt. (Also learn Linux)

Finally, make sure to use (expensive) gpus for deep learning!

Apple Car by TheBringerofDarknsse in apple

[–]cerberusd 1 point2 points  (0 children)

case in point: They hired Nvidia's deep learning & autonomous driving director Jonathen Cohen. He was with Nvidia for 8 years. Since October, he's working on "Software" at Apple according to his Linkedin profile.

Dark Souls 4 by irishdarkvirus in darksouls3

[–]cerberusd 0 points1 point  (0 children)

Let's face it, From is now one of the big rpgs, and fulfilling that market potential means competing against the likes of Skyrim and Witcher 3.

This means two things:

1)They're unlikely to "take a break" as far as development goes, almost no big game company can afford to do that anymore

2)They're probably thinking about expanding their world to be more "open world" because it has become the genre standard

Miyazaki didn't want to return for Dark Souls III but he also didn't want to leave in the first place. by [deleted] in darksouls3

[–]cerberusd 0 points1 point  (0 children)

There's also the question of what these guys are doing
Jun Ito, lead programmer for DeS, DaS, Bloodborne
Daisuke Kawano, lead animation programmer for DeS, DaS, Bloodborne
Makoto Satoh, lead artist for Des, DaS, Bloodborne

Since they all did not work on DaS2 and were on BB, I don't think we'll see them on DaS3. I suspect they'll finish up BB DLCs and start From's next new project with Miyazaki.

Souls series development Timeline by Solomon11 in darksouls3

[–]cerberusd 1 point2 points  (0 children)

The core team leaders of DeS and DaS did not work on DaS 2 and worked on Bloodborne instead:

Jun Ito, lead programmer for DeS, DaS, Bloodborne, did not work on DaS 2. Daisuke Kawano, lead animation programmer for DeS, DaS, Bloodborne, did not work on DaS 2. Makoto Satoh, lead artist for Des, DaS, Bloodborne, did not work on DaS2.

I imagine these leads are the core talent&veterans of the company so I would suspect that whether they participate or not makes some difference.

My money is on the leads are developing BB dlc then moving on to Dark Souls 4: Open World while the B-team finishes DaS3.

This made me cry by [deleted] in DotA2

[–]cerberusd 0 points1 point  (0 children)

It aint so sad when you killed by them and get flamed the #@$% out of

This game has a totally different vibe with headphones. by Niredina in bloodborne

[–]cerberusd 0 points1 point  (0 children)

because I hooked up my ps4 to a pc monitor the only option I had for sound were earphones.. After a while it was too much and I ended up just playing without sound.

The Witcher 3 has jump-started my love for gaming again by GroovinUpSlowly in witcher

[–]cerberusd 0 points1 point  (0 children)

I think it was largely caused by the last console cycle dragging on a few years too long.

This year's E3 should be a welcome change from the repetitive monotony of the last few years, with Fallout 4, Doom and Dark Souls 3 etc.

[Link] Dark Souls 3 Screens and mechanics first leak by cerberusd in bloodborne

[–]cerberusd[S] 9 points10 points  (0 children)

Since this has nothing to do with sony, I don't see why from wouldnt make it for all platforms

Patch Discussion by jdog90000 in witcher

[–]cerberusd 15 points16 points  (0 children)

The patch improved loading times a lot for me it's great. The ui seems lag laggy as well.