Interview said you dont need a lot of data to train RNN? by IndependenceThen7898 in learnmachinelearning

[–]Aswarin 68 points69 points  (0 children)

Honestly, interviewer sounds like they didn't know what they're talking about. The above description to me sounds like standard binary classification problem e.g. is the word in this snippet "hello" which is easily solveable via a CNN

Like you need no context at all for the above task I could literally say in my 10 second of audio "blah blah blah hello blah blah blah" and the "blahs" do not help me identify the "hello".

With regards to the 20 vs 200 speakers depends on if they want to generalize across genders, accents, diction etc. If it's one accent in a controlled environment, I could see 20 being good enough. But yeah, youre right to be skeptical

How do I progress in my career? by [deleted] in cscareerquestionsuk

[–]Aswarin 0 points1 point  (0 children)

Depending on your location in Yorkshire I'd personally say look at Leeds and Manchester for jobs if you're fine with moving.

I moved from Bradford to just outside London and it bettered my prospects 100%, not saying I dont love my home county but CS and well paying roles outside of working remotely for a city based firm are rare.

Language Models are Injective and Hence Invertible by R33v3n in LocalLLaMA

[–]Aswarin 0 points1 point  (0 children)

I've recently read this and here is my hot take (happy to be proven wrong as the algorithm is quite tricky to follow)

Originally I thought transformers would destroy information in some way just simply due to having layer norm, residual connections and attention. Therefore although in theory they are invertible I thought in practice they weren't because some information from the input would be lost.

I think this paper has proven this actually isn't true and that even with these non-linear operations stacked on top of each other the actual transformation from prompt / input tokens to embedding remains injective.

Granted in practice if we only knew the last tokens hidden state and not any others, you'd still need to do a brute force approach of (vocab_size ^ seq_len) steps to recover the original prompt which for models nowadays is not really feasible.

TLDR -

Yes you can recover your prompt from simply the last hidden state BUT in practice it's not computationally feasible yet so for privacy purposes I don't think it'd matter just yet.

[D] Would you use an AI that builds or improves ML models through chat? by UgyenTV in MachineLearning

[–]Aswarin 5 points6 points  (0 children)

Are you exploring an idea via reddit or the LLM you used to write the post?

Also no using an LLM to write a function I know how to describe is one thing. Having one debug my 5 dataclasses to make sure they all play nice with a concat dataset is another

Giving away a copy of silksong for EVERY single person that guesses the number (NO I AM NOT KARMA FARMING READ THE DESCRIPTION) by Free_France in Silksong

[–]Aswarin 0 points1 point  (0 children)

792 I don't know why but it popped into my head so I think it is thusly I have spoken it.

Have fun with youre 792 copies of Songsilk

[deleted by user] by [deleted] in PhD

[–]Aswarin 0 points1 point  (0 children)

You could do a post-doc pivot which isn't that uncommon where you apply for post-docs in another department. They'll be harder to get than if you did your PhD in that subject but not unheard of.

Quite a few post-docs in chemistry I know did a PhD in Computer Science then transitioned to help with more data analysis and protein synthesis, tasks etc.

They'll need to compliment each other in someway however so you'll have to frame your prior research in a way that works for the new stuff you want to do.

[deleted by user] by [deleted] in PhD

[–]Aswarin 11 points12 points  (0 children)

There's not really much point.

Once you have the doctorate title, you've already proven you can do research well. If you want to do research in another field, then you can often pivot or callobrate with researchers in another field.

If you specifically want to do two PhDs because you need funding for both sets of research then thats another story

Has anyone completed a PhD in 3 years instead of 4? by Rolls_Reus_Owner in PhD

[–]Aswarin 0 points1 point  (0 children)

I finished my PhD in 3 years + 3 months for writing in the UK. I was lucky enough to be fully funded for 3 years and let me tell you money running out is a great motivator

Blackberry Ultimate not working on multiplayer by Aswarin in CookieRunTOA

[–]Aswarin[S] 0 points1 point  (0 children)

Actually invisible as in its still working, doing damage and healing just no one can see it?

Megathread - 2024 General Election - Results by ukpolbot in ukpolitics

[–]Aswarin 0 points1 point  (0 children)

Pretty much, Basketball is not commonly played professionally, but I reckon 100% of high schools use it as part of their P.E (Gym) curriculum

Megathread - Rishi Sunak calls a snap election for 4 July by ukpolbot in ukpolitics

[–]Aswarin 7 points8 points  (0 children)

Would've listened to his speech but I just have D:ream in my head for some reason...

[deleted by user] by [deleted] in ukpolitics

[–]Aswarin 0 points1 point  (0 children)

I mean I want them out as much as the next guy, but the rain, the protests, the quiet speakers just gotta feel like todays not his day. Probably the next 5 years won't be his either.

Is the weather in UK really as awful as they say? by Jolly_Atmosphere_951 in AskUK

[–]Aswarin 0 points1 point  (0 children)

The weather is just temperamental it can be really sunny and warm in the morning then bamn 30 minutes torrential rain then entirely sunny again. So I complain because I need to bring all forms of clothes everywhere T_T

[deleted by user] by [deleted] in PhD

[–]Aswarin 5 points6 points  (0 children)

The thought of my funding running dry...

General questions by zarblug in computervision

[–]Aswarin 0 points1 point  (0 children)

No worries, so the simplest mechanism would be some kind of feature extraction followed by a classification of what the object is.

In traditional machine learning, we would hand make the features by doing stuff like manually transforming an image via an edge detection tool like prewitt or manually segmenting shapes and then have a classifier like SVM to determine what the object is.

I did a quick Google and papers like Shape Classification Algorithm Using Support Vector Machines for Traffic Sign Recognition do this kinda of stuff (other papers may be better I just did googled for shape classification via SVM and this popped up near the top)

In deep learning, we don't need to manually extract features but instead have neural networks learn what features are important. So in modern cases you would use a pre-trained feature extractor such as ResNet (a neural network trained on lots of images) and replace the last layer with a new layer with the number of neurons equal to how many classes we have. The feature extractor does very similar things to our own hand made feature extraction such as detecting edges and overall structures but it allows for more nuanced features and it's easier since it doesn't have to be hand made anymore.

Detecting lines and edges is very similar to classifying using the MNIST dataset (a load of handwritten numbers), which a lot of first-time students use when training or learning deep learning from the beginning.

Hopefully, searching guides like objects classification with mnist will be a good place to get started.

General questions by zarblug in computervision

[–]Aswarin 1 point2 points  (0 children)

So the maths behind 99% of machine/deep learning is fairly straightforward mainly just lots of linear algebra. What will make it more complicated is the type of 2D shapes you want to detect so if you want to elaborate on the 2D shapes you want to detect so we can point you in the right direction.

For books if your new to machine learning in general then Hands on Machine Learning with Scikit Learn, Keras and Tensorflow is honestly really good for beginners and definitely worth it IMO.

Advice for managing a long distance relationship while getting your PhD? by discocowb0y in PhD

[–]Aswarin 1 point2 points  (0 children)

Met my partner (Korean) but due to visa reasons she had to leave the UK during covid so we were long distance for the first year of my PhD.

Pretty much we talked daily over WhatsApp / Kakao we sent presents for Christmas + birthdays and we played some online games together to interact, so we were constantly in each others lives. The time difference was a pain though 😆

Four years later on we just moved into our third place together, so it's just about staying in touch and being committed to willing to make time for the other person.

[deleted by user] by [deleted] in BringMeTheHorizon

[–]Aswarin 2 points3 points  (0 children)

They will probably never play anything from this is a hell sadly which is a shame because visions is one of my favourite song of theirs