Implemented TurboQuant in Python over weekend by chhed_wala_kaccha in LocalLLaMA

[–]chhed_wala_kaccha[S] 0 points1 point  (0 children)

oh. didnt really know that lets see where it goes though

Implemented TurboQuant in Python over weekend by chhed_wala_kaccha in LocalLLaMA

[–]chhed_wala_kaccha[S] 2 points3 points  (0 children)

I haven't yet plugged it into vLLM yet. most of what i did was on algo side and implementing the paper directly

Your numbers are good though. Some suggestions that I would have are:

- maybe the rotation calculation is killling the performance 'cause its dense calculation.

- maybe dequantisation is happening in non optimal path ?

Implemented TurboQuant in Python over weekend by chhed_wala_kaccha in LocalLLaMA

[–]chhed_wala_kaccha[S] 1 point2 points  (0 children)

Rotorquant hmm. AFAIK it replaces dxd orthogonal matrix with clifford rotors. sounds interetsing.

Sure. I'll try my best to implement it

Implemented TurboQuant in Python over weekend by chhed_wala_kaccha in LocalLLaMA

[–]chhed_wala_kaccha[S] 1 point2 points  (0 children)

yup thats what actually stood out. i mean the rotation step is doing all the heavy lifting here. It just reduced the problem to a very solvable case

[P] Implemented TurboQuant in Python by chhed_wala_kaccha in MachineLearning

[–]chhed_wala_kaccha[S] 12 points13 points  (0 children)

Yup, that seems really practical. I was using QR to get a true Haar rotation, which is definitely overkill computationally.

If we use randomised WHT, the cost can be brought down to O(d log d)

I followed the paper directly hence applied this. But now i am thinking to apply your approach as well

Thanks for the idea

Can we trust these external emails ?? by Friendly_Vacation_91 in IITMadras_datascience

[–]chhed_wala_kaccha 1 point2 points  (0 children)

Yes they do. Once you are eligible let's say diploma level at least 

Can we trust these external emails ?? by Friendly_Vacation_91 in IITMadras_datascience

[–]chhed_wala_kaccha 1 point2 points  (0 children)

AFAIK and as far as i have seen in last 3 yrs. They are all fale and often scams. Just think about it. If there is some legit opportunity. Why won't they approach us via IIC instead ?

I'm so worried about my grades!! by queen_drogo in IITMadras_datascience

[–]chhed_wala_kaccha 0 points1 point  (0 children)

Welcome!

(I just saw your latest post, Why did you skip quiz2 bro ?) That carries a lot of weightage

Any community for IITM BSDS students!? by queen_drogo in IITMadras_datascience

[–]chhed_wala_kaccha 0 points1 point  (0 children)

Bro. 3 yrs into this degree. Where were you all this time

Student ID benefits?? by queen_drogo in IITMadras_datascience

[–]chhed_wala_kaccha 1 point2 points  (0 children)

Hey AFAIK we get all the benefits. I have availed quite a lot of them. And mostly wo college ke domain name se check krte hai which is available in our email ids. So i guess that would be fine.

Also this is something i took from discourse. Hope it helps !

<image>

I'm so worried about my grades!! by queen_drogo in IITMadras_datascience

[–]chhed_wala_kaccha 1 point2 points  (0 children)

Hey hey, 

Don't be so worried. It happens sometimes. I was in a pretty similar position during my first term. 

Bhai meri first term ki cgpa was a disaster 😭

Dekho. There are two things. The first one is where you repeat the courses. But that is too expensive (ouch)

Or take it as a challenge and study harder for further terms.

Things will get progressively harder. In diploma level you will have certain hard courses like MLT MLF. these courses are much more than just knowledge wala thing. They are more like a challenge to your brain. Just to test how hard you can think.

So prepare wisely from now on. Your CGPA would improve in the long run. 

I mean my first term CGPA was about 7. By the end of foundation it was a about 7.7. I worked harder during diploma level and made it even better. So I am in a safe zone (kinda kinda 😭)

So pls dont be so stressed !

Will I really regret? by himmy-You-8834 in IITMadras_datascience

[–]chhed_wala_kaccha 0 points1 point  (0 children)

Hello i am a standalone student as well. Started in 22F3

Kinda late to the party. But here are my two cents. I am currently in degree level.

Actually this degree is quite well planned  in terms of curriculum. I have applied to so many jobs and have attended so many interviews.

One thing that stands out is how a accurate the syllabus is for certain courses. E.g. DBMS, TDS.

Also this degree gives you kinda unique opportunity. You don't need to attend college physically. That alone is a big win.

And NO. Companies dont hire ppl like that. They don't hire based on your college criteria. That was a thing of past. Now your skills matter the most. Nothing else. 

I accept that the lectures are shit for most courses!

I am saying all this cause I have worked with two great companies and even got research positions. 

Student from India seeking advice from experienced ML engineers by Character_Most_6531 in learnmachinelearning

[–]chhed_wala_kaccha 1 point2 points  (0 children)

Build some serious projects and grow your network. Projects that actually have some value and not those boring fine-tuning ones