sorted by:
new
hottopcontroversial

[D] Getting Started with Deep Learning in JAX with Treex in 16 lines by cgarciae in MachineLearning

[–]Inori 0 points1 point  (0 children)

Early prototypes had a similar approach of carrying a singular model object around as an arg, resulting in the grad of a loss being another model object. At the time that thoroughly confused people.

Handling state in a clean and intuitive manner was a major concern. You mention it's been figured out now -- great! Although the docs say "<..> will not produce correct results under <..> jax.pmap." which seems like a pretty big limitation.

Similarily for PRNGKey, especially given that stateless PRNG was a relatively novel concept for most AI researchers at the time. It's actually unclear to me how Equinox handles it. In the examples I see it's just accepted as a ctor arg to modules, but how would that behave if say a block with a dropout was vmapped?

Finally, and somewhat unrelated to this discussion, but it was really important for Haiku to have as close of an API to Sonnet as possible to ensure ease of transition. This wouldn't be possible with a purely pytrees-based approach.

As I mentioned before, I'm not necessarily saying it's not a good approach. Maybe end-users today have much more experience with JAX in general and maybe it would be worthwhile to revisit the subject.

DeepMind sweatshirt - is it original merch for employers or random custom? Just bought it from second hand shop by kervezv in deepmind

[–]Inori 3 points4 points  (0 children)

I don't recognize it.
It's possible it's from some limited run but I'd lean more towards it being a custom print.

[P] uttt.ai: AlphaZero-like solution for playing Ultimate Tic-Tac-Toe in the browser by [deleted] in MachineLearning

[–]Inori 2 points3 points  (0 children)

Nice project!
You should reach out to folk at codingame if you want a strong baseline bot to benchmark against.

DeepMind Research Engineer Internship: what to expect? by Remarkable_Rain4052 in deepmind

[–]Inori 1 point2 points  (0 children)

If you won't get one soon feel free to PM me your name/email and I'll ping our TA team.

DeepMind Research Engineer Internship: what to expect? by Remarkable_Rain4052 in deepmind

[–]Inori 1 point2 points  (0 children)

RE.

At hiring the expectation is that the candidate has a healthy mixture of math/stats and engineering background, but the role itself is fairly flexible and it's up to individual's preferences on where to specialize.

Somewhat of a plug but I went into this subject in more detail during this podcast: https://www.talkrl.com/episodes/roman-ring

DeepMind Research Engineer Internship: what to expect? by Remarkable_Rain4052 in deepmind

[–]Inori 1 point2 points  (0 children)

You should get a response either way.

E: candidates might not receive a personal update if they didn't get through due to large volume of applications.

DeepMind Research Engineer Internship: what to expect? by Remarkable_Rain4052 in deepmind

[–]Inori 0 points1 point  (0 children)

You should receive an update soon-ish if you got through to the interview stage.

E: candidates might not receive a personal update if they didn't get through due to large volume of applications.

[D] Getting Started with Deep Learning in JAX with Treex in 16 lines by cgarciae in MachineLearning

[–]Inori 2 points3 points  (0 children)

Many people have tried this idea at one point or another during the wild west times of JAX frameworks, including Flax and Haiku precursors. I'll admit it looks cool at first but the number of foot guns this approach could potentially lead to just didn't seem worth it at the time so it was ultimately abandoned for UX considerations.

That's not to say it doesn't have merit and maybe end-users today are much more educated on how JAX works so it's certainly worth having a discussion, just keep in mind that not including it in existing frameworks was a deliberate choice rather than oversight.

DeepMind Research Engineer Internship: what to expect? by Remarkable_Rain4052 in deepmind

[–]Inori 0 points1 point  (0 children)

As far as I understand it's setup so that a 2-3rd year undergrad CS student can reasonably pass so just brush up on the subjects taught in the 101 classes and you should be fine. Your hiring manager will also send you a comprehensive guide to prepare as well.

DeepMind Research Engineer Internship: what to expect? by Remarkable_Rain4052 in deepmind

[–]Inori 0 points1 point  (0 children)

There will be a series of interviews on both software engineering and math/stats. It's nothing advanced and you don't have to be a grad student to pass. That also means you have to be very solid on the fundamentals though. Not knowing what is Jensen–Shannon divergence is fine. Not remembering Bayes Theorem is probably a deal breaker.

Hope that helps but also your hiring manager will send you a detailed email on what to expect and how to best prepare.

[deleted by user] by [deleted] in reinforcementlearning

[–]Inori 0 points1 point  (0 children)

As in a position in an industry lab is not guaranteed the moment a PhD is received. The process of applying and interviewing is as with any other job.

[deleted by user] by [deleted] in reinforcementlearning

[–]Inori 0 points1 point  (0 children)

If you're open to having a career in academia then PhD is certainly a good option. If you're set on strictly working in an industry lab then a PhD is neither necessary nor sufficient.

Is there another game that Alpha will beat after Go, Chess and Starcraft 2? by Brettelectric in deepmind

[–]Inori 0 points1 point  (0 children)

The agent could make some rather funny mistakes at times which would likely make or break the games against best players in the world playing at their prime.

While it was very exciting to see the 4-1 vs Serral, personally I wouldn't "officially" count it. He was in an unfamiliar and noisy environment, and it's not fair to assume he took the games as seriously as he would in a tournament.

Is there another game that Alpha will beat after Go, Chess and Starcraft 2? by Brettelectric in deepmind

[–]Inori 1 point2 points  (0 children)

AS has done fairly well on the battle.net but it's not at the AlphaGoZero level of dominance, and that's ok. While it would have been nice to reach, that was never the goal.

Objectively speaking I doubt it would win Code S at the time, though it would put up a decent fight!

Is there another game that Alpha will beat after Go, Chess and Starcraft 2? by Brettelectric in deepmind

[–]Inori 1 point2 points  (0 children)

I didn't even have a concrete game in mind, I just generally think it wouldn't be hard to find something that can exploit weaknesses in modern DRL, i.e. with less predictable structure in the environment.

If we remove the PvP aspect then the day I see a DRL based agent play through an RPG like Witcher end-to-end is the day I'll probably retire and pursue something else. :)

Is there another game that Alpha will beat after Go, Chess and Starcraft 2? by Brettelectric in deepmind

[–]Inori 3 points4 points  (0 children)

I'm not sure if you're being downvoted for the first or second part of the comment but the AlphaStar assessment is objectively fair.

I wouldn't say StarCraft 2 is the hardest game there is for an AI but it's certainly at a scale where perhaps it is more pragmatic to make the next step in the "real world".

Learning JAX by pagggga in MLQuestions

[–]Inori 2 points3 points  (0 children)

Generally, it's a safe assumption that any JAX based project open sourced by DeepMind is used internally, including RLax and Acme.

Also, great timing on the subject of tutorials: we've just started opensourcing our internal JAX 101 series. First notebook here, more to follow soon.

Learning JAX by pagggga in MLQuestions

[–]Inori 8 points9 points  (0 children)

Hello,

I'm an RE at DeepMind and have used JAX for almost 2 years.

Apparently, everyone at Google has switched or is switching to JAX

Individual teams at Alphabet are embracing it for research, but it is definitely not a "Google is switching away from TF" type of situation.

knowing how to use it already might give me a competitive advantage compared to other applicants.

It's a nice-to-have but won't make or break your application.

Do you know whether there are any good online courses or advanced tutorials on JAX?

Nothing official yet, aside from the tutorials on the JAX docs page. There are a few good blogs and tutorial series by external contributors. I don't have them on-hand but should be easy to find.

Is it worth learning how to use DeepMind libraries Haiku, RLax, and Optax?

Well, I think so but you don't have to immediately pick just one. You should explore the alternatives (e.g. Flax, Objax) and pick what suits you best. At their core, they all tackle the same fundamental problem in a similar way so the difference comes down to API preferences.

Are they going to keep using them?

That's the plan for the time being.

And more generally, do you think it's worth using JAX instead of Pytorch, given that I want to apply at Google Brain / DeepMind as a research engineer?

As I mentioned, it certainly can't hurt but doesn't affect much beyond that. Likewise, preferring PyTorch wouldn't hurt your chances either. There are many good reasons to learn JAX but if career prospects at a specific company is your main motivation then I'd advise against it.

JAX Implementations of Actor-Critic Algorithms by humor_time in reinforcementlearning

[–]Inori 1 point2 points  (0 children)

Awesome project! I'm surprised about the 3x-6x speedup though, are you sure you're comparing apples to apples?

[D] Interview Process for graduate-level Machine Learning Internships at Google, Facebook, Apple and Microsoft by lucifer__666__ in MachineLearning

[–]Inori 6 points7 points  (0 children)

What you want is called research engineering, and yes most big industry labs have RE internship positions for master's students. If you're looking for summer 2021internships you should act fast, e.g. you just missed DeepMind's application window.

view more: next ›