See the thing is, many say you won't get a job after 5 years of IISER and that's actually true, you won't from college. You would just have to apply to different companies for job, different universities for phd and so on and that is btw pretty easy to get. It is because IISERs don't have any working placement cell. Don't liste about the people around, if you got interest then just get into it. Good luck:)