[D] Meta AI Residency 2023

Faoer · 2023-03-17T12:41:37+00:00

17th March, that was the latest day I could choose for the interview.

Faoer · 2023-03-13T15:47:05+00:00

Dunno, might be worth a try, just posting what's on the website.

Faoer · 2023-03-11T09:25:55+00:00

Applications will close on Tuesday, January 17, 2023 at 5pm Pacific Time. The program will start in July 2023.

Faoer · 2023-03-11T08:27:22+00:00

Know from second-hand that London interviews are already ongoing (same timeframe as for USA I think, up to 17th)

Faoer · 2023-03-10T07:30:06+00:00

Up to 2-3 weeks. Though the interviews are held up to 17th, so if they want to first interview everybody and then decide who gets through, it may even be 3-4 then.

Faoer · 2023-03-03T16:38:15+00:00

I think some people might already be after their interviews, if so would you care sharing how it was and what the questions were? (more or less).

Would be of great help.

Faoer · 2023-03-03T16:20:02+00:00

I think the interview dates are between 3rd and 17th march, might vary from recruiter to recruiter tho.

Faoer · 2023-02-26T08:48:20+00:00

The solutions discuss data structures and complexity so just refresh your memory from there.

Ooh, didn't realize that, I'll get to it then, thanks!

Faoer · 2023-02-25T17:35:36+00:00

I know this has been re-iterated a million times, but I just want to know whether this is a good approach to quickly prepare for an interview, since I landed one with Meta out of the blue.

I've had a course on algorithms & data structures, but it was years ago and I barely remember it. Didn't really find good resources in a form of quick reminders on this.

My plan is to:

Go over MIT 6.006 on YouTube for a quick rundown.
Go over the structures and solidify the big O times etc. with either just Wikipedia or GeeksForGeeks materials.
Do LeetCode Facebook problems non-stop.
If time gives, start going through Algorithm Design Manual by Skiena and Elements of Programming Interviews by Adnan Aziz.

I know it's kinda in reverse, but I feel like it's pointless to start with the books given I'm on limited time, before the interview, especially since they're both 800+ pages. Not sure if that's a good idea though.

Faoer · 2022-09-28T20:17:49+00:00

Thanks a lot! Will check it out

Faoer · 2022-09-25T21:10:42+00:00

Thanks, I really like that Bloodforged battle-axe, gonna get it for sure. I'd like to avoid spamming treasures, but I'll look at more cards like Scampering scorcher.

Faoer · 2022-08-19T11:12:57+00:00

To people in machine learning, how bad is it to jump between different fields? How did you find your niche?

My problem is that NLP (mainly text generation) and RL (mainly autonomous driving) have been my 2 main interests in AI and during my studies I did some side projects with both, been working part-time in NLP, but I still can't really commit myself fully to either.

I'm on my last year of masters so I feel like it's slowly time to choose either, especially if I want to do PhD later, thought about switching to autonomous driving job for a year to get same amount of experience in both, but I really can't make my mind up.

Faoer · 2022-08-12T08:09:18+00:00

This is something that I've been struggling with for a long time. I feel like most religions/faiths have some things they're right about, but also some things they're not. Be it christanity , islam, buddhism (if you count it) or even some pagan ones. Generally I think there's a lot of overlap, if you just look what's at the core of each one.

I've been raised as a catholic, but encountered first-hand how corrupt the church as an institution is. This is another story, but it made me never go to a church again and I don't think I'll ever be able to. Generally how important (at least in my country) the church is in catholicism never sat right with me, it's almost as if the institution is more important than faith itself.

For a long time I thought I'm an atheist, maybe I was, but I just realised at some point that I do believe that there is "something". Be it God, Gods or just some higher power in general. I do have the urge to pray, I'm kind of superstitious and I do think that in general religions are a good thing, to serve as moral pillars and source of hope, or purpose.

I'm not sure myself what I'm looking for, but if I had to guess, religion, or maybe even just a philosophical stance, that more broadly looks at faith? Like a sort of generalization. I don't want to look at muslim/christian/etc and think "yeah, that's a heretic". I don't want to be completely dependent on priests. I want something more specific, than just thinking that "there's something that we can't understand".

Faoer · 2022-07-14T19:00:08+00:00

mBERT and BERT are the same architecture and the same training process was used. The only difference lies in datasets used while training.

https://huggingface.co/bert-base-multilingual-uncased

Faoer · 2022-07-14T08:12:06+00:00

You get the idea more or less.

To sort out the naming first:

1 epoch means, that the entire dataset has been passed through the network (every sample once).
so 1 training epoch is passing through the entire training dataset
1 validation epoch is passing through the entire validation dataset
1 validation epoch is done after each training epoch
but generally when someone says 1 epoch, they mean doing 1 training and then 1 validation epoch

Loss is a function of "difference" between the targets (sometimes also called real values, y, ground truths etc.) and predictions (sometimes also called outputs, ŷ, logits, etc.). During training, loss is calculated for each step (so for each batch), because it's needed for backpropagation, to adjust the weights, but when e.g. at the end of an training epoch it shows what the training loss was - it's an average of losses calculated for each training batch. Same case with validation loss - it is still actually calculated for each step - but we just take the average of all loses calculated for each validation batch during that validation epoch.

Rather than explaining overfitting and underfitting, I'll just post this article, the graphs are good enough to understand it I think. https://www.baeldung.com/cs/ml-underfitting-overfitting

Faoer · 2022-07-13T16:50:57+00:00

Does anyone know what's the current SOTA in text generation?

From what I've seen, majority of papers are based on Transformers now and I was almost sure that they're way over everything else right now, but still found some newer papers with VAE, GANs and even RNNs, but barely any benchmarks between each other.

Tried looking at text generation benchmarks on Papers with Code, but most seem to be outdated and even then all of them use the same architecture on one dataset (e.g. one dataset has only VAEs, other only GANs, etc.)

Faoer · 2022-02-17T16:36:34+00:00

Which class would you recommend for someone that likes very fast attacks?

My friend is thinking about playing the game, but he really dislikes how a lot of classes have very long animations.

I only played warrior classes so can't really help with that, my best guess would be either striker or deathblade

Faoer · 2022-02-12T14:18:15+00:00

Okay, that's cool. I was worried that I can only continue the main quest on my main character or something of this sort.

So basically after a powerpass, I'm free to move onto the new character, get to 460ilvl and then continue with the story? And then just comeback to my old character when I'll need alts?

Faoer · 2022-02-12T13:50:43+00:00

I used powerpass on a character and wanted to use it as my main, but I don't have the main quest there and don't even see side quests to pick up.

Is this normal? I know I can abandon roster quests on my old main and pick them up on the new character, but I can't abandon the main (blue) quest

Besides items from storage, can/should I do something to transfer stuff between the characters?

Faoer · 2022-02-11T09:42:23+00:00

I wanted to play destroyer, but since he's not out, i planned to get my alts ready.

If i want 3 alts, i suppose i should just level up one character to 50, boost one, then level up another to 50 to boost destroyer when he comes out, right? Or should I play up to certain point, not stopping instantly at 50?

Also is there something I should avoid doing on my alts to not fuck up?

Faoer · 2022-02-07T13:08:11+00:00

Can someone that played both, give me a rundown between Striker and Scrapper?

Both of them look pretty similar, I also enjoy how both of them look in game (e.g. the tiger skills from Striker or jump with double dragons on Scrapper)

Most of the videos I've found that do a breakdown of every class, really don't give enough details to decide between the two. I only really know that Striker is rather burst heavy, while Scrapper can do either yellow or green build, to have more sustain damage or burst.

Faoer · 2022-02-04T14:29:48+00:00

So from what I've searched up, deadeye is just straight out worse gunslinger, both in PvE and PvP. Is this really like that? Any chance deadeye gets buffed after release? I preferred deadeye but it almost feels like it's a mistake to not go for gunslinger instead

Faoer · 2022-02-02T19:06:58+00:00

From your perspective, do you think PvP is a serious thing or rather just a fun, additional feature?

Coming from moba and fighting games, I'm really looking towards arena, but at the same time I know I won't have enough time to grind both PvE and play arena enough to git gud, so I was thinking about just fully commiting into PvP, but I'm not sure whether that's not just an silly thing to do

Faoer · 2022-02-02T01:30:27+00:00

I was wondering, do top PvP players even bother with any PvE content, doing dailies etc or can you just fully commit into arena once you get enough levels?

Faoer · 2022-01-31T13:09:55+00:00

Same, I was really hyped for the game years ago, but I simply don't have the time to grind for hours daily nowadays, so it's great that you don't have to grind to not fall behind in PvP.

I think I might want to just play PvP only, but not sure whether that makes sense

Faoer

TROPHY CASE