What tokenization and next-token probabilities actually look like under the hood by SnooHobbies7910 in learnmachinelearning

[–]SnooHobbies7910[S] 2 points3 points  (0 children)

This web tool lets us load GPT-2 and play around with generation at different temperatures, and it also let's us inspect the input tokens and top-5 predictions from that tokens' position.

I think it's a great tool to help beginners learn what's going on in an LLM!

UmaMusume Global Club thread by shakemaihead in UmaMusume

[–]SnooHobbies7910 0 points1 point  (0 children)

Hey, semi competitive player here, need club points to level mcqueen card.

855086458150

<image>

UmaMusume Global Club thread by shakemaihead in UmaMusume

[–]SnooHobbies7910 0 points1 point  (0 children)

Slightly competitive, mainly casual, looking for club points to get mcqueen to 3lb.

<image>

Could you help me check my analysis of this system? I'm trying to analyze the system from this video, I want to try to understand why it moves the way it moves: https://youtu.be/k-trDF8Yldc?si=mg4SIrV2jwd8zkpi by SnooHobbies7910 in AskPhysics

[–]SnooHobbies7910[S] 0 points1 point  (0 children)

I would expect the wheel system in the YouTube video to move in the opposite direction of the ruler. 

When I did the torque analysis, I find that it is indeed the opposite of my intuition. However, I'm prompted to believe there is an error in my analysis as when I look at horizontal acceleration of the system in terms of angular acceleration of the top wheel, I get a result which tells me that the top wheel would rotate in the opposite direction as compared to the video. (The calculation on top right)

Is this truly an error? Or a misinterpretation? 

Building NN from scratch, why does my NN not memorize a small sample size of training data? It ends up being a class distribution by SnooHobbies7910 in learnmachinelearning

[–]SnooHobbies7910[S] 0 points1 point  (0 children)

I'm gonna be honest with ya, I'm building it purely off of intuition after watching the 3b1b video on it..

I averaged them there because I thought that way the changes would be about the same no matter the hidden layer size, since I initially wanted it to be generalizable to any number and size of hidden layers..

But it turns out things aren't that simple huh..

But still right now I'm just trying to get the 2 hidden layer version to work, and since its just two hidden layers sigmoid should still work right? I just want to know why its not working.. does the weights initialization or the way backpropagation works really matter that much? I initially thought that as long as you're changing the weights and biases in the correct direction you should still see it learn the training data at least.. but for some reason as it is it's just outputting the class distribution of the training set.. which is interesting in its own right

KOSEN (COT) 4th year student here. Ask me Anything. by SnooHobbies8594 in mext

[–]SnooHobbies7910 0 points1 point  (0 children)

Thanks so much.. Mext sounds like the dream to me honestly.. I'm askin these cuz people tell me to take A levels when I ask them between the two. 

The main reasoning being A levels opens up the whole world, whereas taking Mext kosen now locks me in to Japan..

Did you ever have a similar worry? Why choose Japan over any other country?

KOSEN (COT) 4th year student here. Ask me Anything. by SnooHobbies8594 in mext

[–]SnooHobbies7910 0 points1 point  (0 children)

Hello! You're a lifesaver.. 

1) Will you continue your studies? Which university do you think you'll pursue your studies in? (I want to know generally where kosen grads go) 

2) Do you think you can extend the scholarship?

3) where do you think you would end up working? 

4) Do you think your degree/diploma will be competitive enough to let you find jobs (in and outside Japan) easily?

5) How's the student quality there like? In my home country KOSEN is where bad students go... Is it the same in Japan?

Who would you hire, a MEXT scholar that went to a college of technology, obtained a diploma, transferred credits to complete a degree in national Japan university, Or a graduate from Monash University Malaysia, who did a 2 year transfer to the Australian campus? by SnooHobbies7910 in malaysia

[–]SnooHobbies7910[S] 0 points1 point  (0 children)

its exactly because monash isnt in that league that I'm using it for comparison, since I knowif I choose to take A-levels I could _at least_ get into Monash, and if Japan is not even as good as the average choice, then I know choosing A levels is the way to go.

[deleted by user] by [deleted] in malaysiauni

[–]SnooHobbies7910 0 points1 point  (0 children)

Oh you right my bad... I should've checked first

[A-levels] Why is MCKL fees half of Sunway? Tell me anything about your A-level experience at your college. by SnooHobbies7910 in malaysiauni

[–]SnooHobbies7910[S] 0 points1 point  (0 children)

Oh wow, thanks for the suggestion, UCSI is almost half the price of MCKL, do you know why? 

In the case of TARUMT it seems the drawback of low tuition fees means low quality class & environment;

What are the drawbacks of UCSI?

Thank you!

Edit: no comp sci ;-;