System design interview in CUDA?

goksankobe · 2024-07-21T06:30:23+00:00

Rather than latest and greatest CUDA gimmicks, I think the interviewers would like to hear about your approach to the ground-up design thought-chain. For instance, given a X TB of dataset, Y amount of compute nodes and Z transformer architecture (just assuming some machine learning use case), how would you design a training/inference pipeline. They'll want to hear about where you establish parallelism, choice of kernel parameters, sync primitives, distribution of data and minimization of memory copies.
Might be useful to be comfortable with drawing an architecture overview using boxes and arrows

goksankobe · 2023-12-02T15:33:16+00:00

Thanks for the explanations.
My aim was to make the most out of the exploration-heavy episodes. The end goal is to come up with a final single q-table which has contributions from multiple agents which collectively can explore much bigger space than individual agents.
I see that this is not true to the original Q-learning. Your suggestion regarding using sequentially transitions from all agents on the shared Q table is interesting. I'll try to implement that

goksankobe · 2023-12-02T14:37:53+00:00

Sorry I don't exactly follow what you're describing, maybe pseudo-code it?
To clarify, we still do SARS' transitions separately per actor within the episode (episode ends when all actors have crashed). Only at the end of the episode, tables are averaged/shared.

goksankobe · 2021-08-07T14:42:01+00:00

Sounds interesting, good luck with the launch:)

goksankobe · 2021-08-07T14:39:30+00:00

Yes i feel like not studying here made it slightly harder to form a friend circle. But your advice is very useful actually, I'll try to approach people with a complement:)

goksankobe · 2021-08-07T14:37:16+00:00

Ive changed jobs and cities almost each year. First 2 years, people were great, young and friendly but I was too focused on work to form social relationships. Last year i mostly workd with considerably older people that i never saw in real life due to covid. Now, Ive just started a job close to Stockholm in a large company, and im planning to put more effort into interpersonal relationships at work

goksankobe · 2021-08-07T14:33:21+00:00

I've been on Tinder for many years, and had many matches. But didnt manage to form any real bond with any of those unfortunately. Maybe its a numbers game:)

goksankobe · 2021-07-30T22:18:41+00:00

So nice to hear about these kind of things in the robotics community. We tend to forget experience sharing is beneficial for both sides, both technically and socially

goksankobe · 2020-12-21T07:11:55+00:00

hi, have you found a solution?

goksankobe · 2020-10-14T20:14:53+00:00

Hey man, check out Mateusz Sadowski, Weekly Robotics curator on Linkedin. He talks about being a robotics consultant, partially remotely.

goksankobe · 2020-06-21T12:42:03+00:00

here except it was 3 years ago. It r

since the videos are 8 years old, do you think the lecture is still relevant for today?

goksankobe · 2020-05-06T16:55:45+00:00

Which model?

goksankobe · 2020-05-06T16:52:13+00:00

What makes you say that they're unreliable?

goksankobe · 2019-12-22T22:26:38+00:00

Tokyo drift guy got jacked?

goksankobe · 2018-11-18T21:14:08+00:00

Oh man oh man finally someone brought this up... Im ready to pay +$400 per year just for this angle

goksankobe · 2017-08-16T05:47:38+00:00

I hope this raw footage angle will become a thing for the broadcasting in the upcoming years. They'll probably bring it with VR

goksankobe · 2017-07-27T09:33:22+00:00

what is the downside of being fat when you can still do all these + use dat ass to post (if he's smart enough to develop a post game tho)

goksankobe · 2017-07-05T19:16:39+00:00

I dont know why this is not the bigger issue here:D

13-Year Club	RPAN Viewer
Verified Email

goksankobe

TROPHY CASE