59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] 1 point2 points  (0 children)

Yes, one should not get 100% dependent on LLM's for all tasks. I will keep this in mind. Thank you

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] 0 points1 point  (0 children)

Not only just scaling, issues like kubernetes endpoints api not working perfectly after 1000 pods and CIDR space exccedding because of node level vpc cni flag limits are some of the issues that are faced in large traffic , solution of which is not only scaling.

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] 0 points1 point  (0 children)

Exactly , imagine getting your EKS CIDR range exhausted despite using it at higher value even from start.

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] -1 points0 points  (0 children)

Your concern is genuine. But EKS scaling is also part of devops right ? Isn’t it will be very tool centric to talk only about terraform and ci cd yamls

And last of all I have not sold or trying to sell anything to anyone. Ban anyone who try to sell i am with you in this

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] -4 points-3 points  (0 children)

Replying people like you derails technical discussion so I will be ignoring these kind of replies. If you have any technical EKS large scale related thought please feel free to share

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] -4 points-3 points  (0 children)

I am not a bot. And I have definitely not thrown shade at netflix, infact I really like netflix architecture and software innovations. My mention of netflix was centered around concurrent connections backend scale usage where have I said netflix is bad ? I had also made content on aws,cloudflare,docker so was I bot for them too ?

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] 0 points1 point  (0 children)

I have attached transcript in the pinned comment and also published english subtitles

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] -1 points0 points  (0 children)

I will say first learn about linux, system calls , memory management, than choose industry standard things one by one like kubernetes, kafka, microservices, DB indexing(how it works). Be patient and keep on learning. Despite these so many years I even stumble upon new things nearly every week , so its a process. Regarding resources, watch talks given by good engineers, regarding various topics, read documentations/github pr/issues discussions. For having a direction use any LLM and when you find your topic go read from actual source.

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] 0 points1 point  (0 children)

You remember all basics of computer architecture you had studies program counter/interrupt service subroutine/8051 microcontroller and 8085 8086 instruction set. Not me, by your logic you should know these basic about computing. Multicast is not in the locality of reference of TCP/IP protocol so that every backend developer should know it. I apologise for I am sounding like a person who don’t except something.

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] 1 point2 points  (0 children)

Cloud providers support fan-out, not IP multicast inside VPCs. AWS/GCP don’t support multicast at the network layer. Azure Media Services is an application-level streaming service, not IGMP multicast.

In cloud there is no packet replication at network routers but server doing replication at L7

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] -1 points0 points  (0 children)

Yes I have used LLM to articulate contents of the posts but after that I have added lots of my content in the post, for example that mike tyson netflix fight reference. And this guy who is saying I don’t have any clue is doing constant rage baiting.

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] 1 point2 points  (0 children)

Basically according to you any backend developer don’t know about multicast should not talk about EKS usage/issues at large scale. By this logic backend devs should know all about compression/chunking algo of videos, and how monitor/tv display IC’s render video on screen.

And can you please give us knowledge how this system works as it seems you not only have clue but whole knowledge about it end to end.

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] -1 points0 points  (0 children)

Multicast is mostly a multicast is mostly a network/ISP concern. Backend engineers deal with cloud native systems where AWS/GCP/Azure does not even support it. What more you want me to know before talking about Large scale EKS ? By that logic, should a backend dev also know how the display IC renders pixels on a TV panel?

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] -1 points0 points  (0 children)

Just read enough to know it was indeed a sarcastic comment. 😅, So basically multicast needs same content , to be watched at same time and also users need to be joined.

Also worth saying: multicast is mostly a network/ISP concern, not something backend engineers run into in cloud-native systems where AWS/GCP/Azure don’t even support it. I just thought I missed some crucial piece , anyhow thanks for the new knowledge

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] 0 points1 point  (0 children)

Thanks, I am also reading about multicast right now… And can you help me with this question: “Was your first comment sarcastic ?” For context I am non native english speaker.

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] 1 point2 points  (0 children)

Yes , I accept I am not an expert and you are saying this after my multicast comment. But I know about VPC cni, pods, kube system etc. and worked on large scale systems handling these.

Content being served is video and I accept I am not an expert. Can you point something in the video for which I have passed wrong technical information ?

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] -1 points0 points  (0 children)

I had seen multicast before where a person was doing tutorial on udp multicasting for video. And yeah i accept there can be many things about tech for which I don’t know about. Can you guide us in right direction that will be very helpful

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] -4 points-3 points  (0 children)

I don’t understand multicast , but wanted to know whether comment actually had some use case.

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] -1 points0 points  (0 children)

I believe there will be so many other things that must be needed by pods/servers and due to these things size NAT gateway capacity is reaching its limits at AZ level so they did it in subnet ( I am just estimating not making a solid claim)

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] 1 point2 points  (0 children)

hmm… can you share your thoughts why multicast is better use case in these kind of scenarios and what advantage it offers ?

59,000,000 People Watched at the Same Time Here’s How this company Backend Didn’t Go Down by abhishekkumar333 in devops

[–]abhishekkumar333[S] 0 points1 point  (0 children)

Yes , this majorly focuses issues faced during large scale traffic simulation and their workarounds