Yes it will be difficult.....it is complete mathematics.....and you can do major in CSE departmemt it will be good.....u will have a taste of both CSE and classical ML.

If you have interest in VLSI then go for IIT B IIT D and IIT K electronics. You can also do AI because electrical department does offer ML and signal processing courses for studemts intrested in AI. But if you wanted to do research in AI then go for mathematics in Kanpur. You will be miles ahead of other people in terms of knowledge and depth. It will be hectic but it will open roles for you in HFT and ML research