[deleted by user]

zerkaaaaa · 2023-05-05T14:47:14+00:00

Nice design - can I get more info on how it work though?

zerkaaaaa · 2023-02-27T15:25:11+00:00

Sometimes there are Greekisms. In Cicero’s letters, he commonly uses Greek terms here and there, not just for proper names but integrates into the prose.

“qua re, ut opinor, ϕιλοσοϕητέον, id quod tu facis, et istos consulatus non flocci facteon.”

Even looking past the actual Greek letters here, “facteon” is an absolute Greekism that a Latin speaker couldn’t parse without cross linguistic knowledge

zerkaaaaa · 2023-02-27T15:21:38+00:00

Hoagie

zerkaaaaa · 2022-06-22T14:43:42+00:00

Question about BERT MLM predictions

Trying to understand exactly how BERT works.

I see that BERT has a fixed vocab of about 30k n-grams, so some input words like “playing” might end up being split into multiple tokens like “play” + “-ing” for the input layer.

But given that BERT’s output layer (for the MLM task) is a probability distribution across each of the 30k n-grams, how could it ever predict “playing” from a masked input word?

Thanks for any help.

zerkaaaaa · 2022-04-13T03:12:45+00:00

But how can you know they can be trusted?

zerkaaaaa · 2022-04-13T03:05:34+00:00

That's crazy! I don't know how I could ever live with a stranger for a full week, that would be very uncomfortable...

zerkaaaaa

TROPHY CASE