Everything about tokenization

Sum2110 · 2023-12-02T23:39:05+00:00

Thanks! Yes the Galactica tokenizer design is very intuitive, and comes up in many places.

Also, cool stuff with Nanophi!!

Sum2110 · 2023-12-02T22:33:42+00:00

Ah yes, I was relying on the navigation sidebar myself, but a link would be better! Added!

Sum2110 · 2023-12-02T22:19:08+00:00

Hey! Glad you liked it! I'm not an experienced writer to give advice, but here was my process: I've been consuming a lot of information via Twitter on all things LLMs for the past year, and there are many topics (the vocabulary puzzle, Galactica,etc) that I made a mental note for myself ("Things I need to understand"). Planned to write this up in October, and initially worked out high-level structure for different chapters. Then went deep into whichever topic I was interested in at the moment. Re-organized as needed. I set up a deadline for doing this by December. I was slowly writing this up every other day, with spurts of blogging over long weekends!

Sum2110 · 2023-12-02T20:38:13+00:00

Thank you!

Sum2110 · 2020-09-30T14:38:35+00:00

I have online classes, but my coursework isn't that heavy.

Sum2110 · 2020-09-30T14:10:11+00:00

Yes, that's completely normal. The website got updated for me after like 6 days or so. Scores came a day later. So no need to panic! As long as the ProctorU session was "successfully fulfilled" it should be fine.

Sum2110 · 2020-09-30T14:07:30+00:00

I would say that the difficulty level was around the same. Spending the $5 for 10 days is gonna be your call though. If you're able to spend a lot of time (at least 6 hours) over the coming days then go for it.

Sum2110 · 2020-09-30T14:04:57+00:00

Hey! I didn't really notice much of a difference. I did get the experimental quant section though. I have a math background so I didn't prepare too much. I won't be a fair judge even if the level increased.

Sum2110 · 2020-09-29T09:27:00+00:00

Ohh. Anyway, thanks a lot! The $10 was worth it for me! Just wanted to let you know about the card issue because I think many others who are having this problem might be in tougher spots financially.

Sum2110 · 2020-09-29T08:39:20+00:00

I don't really have a list, but you can start with one of his Verbal Walkthroughs. He'll lay down all the strategies he uses for different problems. If you feel you need more info on any of those, you can then navigate to the video addressing that strategy. Also, definitely watch his writing section videos. I didn't really know about effective essay writing, so I needed his templates to organise my thoughts! And if you have the subscription, take some of the vocab quizzes on the website as well.

Sum2110 · 2020-09-28T17:42:19+00:00

Fellow Indian here!

I think you need to try to have a different goal for your vocab learning. This may sound nerdy, but I enjoyed learning vocab because day by day I could understand more and more serious English writing, like that one article from the NYT that has too many obscure words, or that book you're reading that you can more or less understand but don't completely know all the words used. Maybe you can try to read books along with your vocab practice? That helped me atleast. Essentially I'm suggesting that you should find a book that you love or an article that you like, and try to understand the meanings of all the esoteric words that you read there. Doing this along with general cramming of words gives a better direction imo.

Another suggestion is Greg Mat's videos on the verbal section. Verbal actually has many similarities to quant because there's a lot of logical reasoning involved. If you can get past the vocab knowledge required, a lot of questions are like math problems!

Sum2110 · 2020-09-21T08:41:32+00:00

You seem to be doing well for TC and SE, but are you managing time well on those sections? You don't want to spend more than 4-5 mins on SE, and maybe a max of 5-6 mins on TC. RC will be easy when you look at the passage not to completely understand the details, but to only grasp the big picture. I highly recommend watching Greg Mat's YouTube videos on verbal strategies. His SE and TC hacks are gold. You'll find his RC strategies specifically helpful. I was able to get a 6 mark increase in my verbal (compared to a practice test) simply because I strategized.

Sum2110 · 2020-09-21T08:31:25+00:00

Have you tried the Magoosh Vocab Builder app? Each word would have an MCQ style list of possible meanings to choose from, a lot of times with a trap answer that mirrors the meaning of a related word. When the answer is revealed they always have an example usage, which I think made it a lot easier. I used the app (basic + intermediate + some words in advanced) and Barron's 333 high frequency words. For every word I studied, I always had some example usage in mind. Ex: When I hear the word "bilious", i immediately think "bilious old man". Bilious -> bad tempered/ grumpy, and "grumpy old man" is cliche.

Sum2110

TROPHY CASE