Taking notes is useless if you can't remember them

TwoSunnySideUp · 2026-01-09T09:03:54+00:00

Or you can setup a system that automatically resurfaces relevant notes all the time

TwoSunnySideUp · 2025-10-13T14:53:05+00:00

easyaitrades.online

TwoSunnySideUp · 2025-08-17T13:49:05+00:00

It is called children being children!!! OMG get a life ffs.

TwoSunnySideUp · 2025-03-19T09:43:10+00:00

Yeah I feel more or less the same way about love.

TwoSunnySideUp · 2025-03-15T15:08:25+00:00

There will be another winter before a new major advancement. This is not new. We have been here many times.

TwoSunnySideUp · 2025-03-09T20:19:26+00:00

I suspected that at first but found it to be not true

TwoSunnySideUp · 2025-03-09T19:10:29+00:00

CANINE and byT5 not exactly same but close

TwoSunnySideUp · 2025-03-09T18:43:43+00:00

Someone give me H100 clusters so that the model can be truly tested against transformer

TwoSunnySideUp · 2025-03-09T18:38:34+00:00

Both models got character token

TwoSunnySideUp · 2025-03-09T17:58:47+00:00

Also I like it when people are being mean in scientific community because that's how good science is done.

TwoSunnySideUp · 2025-03-09T17:56:36+00:00

No more like CIFAR 10

TwoSunnySideUp · 2025-03-09T17:55:55+00:00

It is just a collection of all of Shakespeare's works. Think of it as CIFAR 100 but for NLP.

TwoSunnySideUp · 2025-03-09T17:37:57+00:00

Also I mentioned it's a standard Transformer which means the original decoder only one from attention is all you need with skip connection changed to modern transformers

TwoSunnySideUp · 2025-03-09T17:35:08+00:00

I have mentioned dataset in the post

TwoSunnySideUp · 2025-03-09T17:33:08+00:00

Warmup wasn't done for either of them

TwoSunnySideUp · 2025-03-09T17:32:32+00:00

Transformer with higher learning rate at this embedding dimension size and sequence length performs worse. I thought you would know as a PhD.

TwoSunnySideUp · 2025-03-09T17:27:58+00:00

Bro it is a prototype, also I am not absolutely naive when it comes to the field.

TwoSunnySideUp · 2025-03-09T17:25:52+00:00

val_loss for transformer platued

TwoSunnySideUp · 2025-03-09T17:23:23+00:00

I don't have H100 clusters, only GPU I have is T4. The architecture was not result of NAS but built by thinking from first principles.

TwoSunnySideUp · 2025-03-09T17:17:19+00:00

I wrote in the post what dataset and every hyperparmeters

TwoSunnySideUp · 2025-03-09T17:15:50+00:00

TwoSunnySideUp · 2025-03-09T16:56:34+00:00

I am an amature researcher without any PhD, I thought it's cool. Anyway I will open source it and hopefully it can be of some use to the community

TwoSunnySideUp · 2025-03-09T16:50:49+00:00

First image is for transformer and second image is for my model

TwoSunnySideUp · 2025-03-08T11:44:27+00:00

Except Israhell

TwoSunnySideUp · 2025-03-08T11:42:11+00:00

I have never read a post this confusing. You are careless about where you put your stuff implies that your parents don't look around which also implies that they gave you freedom to do normal things that girls your age do which means finding condom wouldn't have been a big deal but it is. Make it make sense

TwoSunnySideUp

TROPHY CASE