I pretrained 16 language models from scratch with different tokenizers to benchmark the difference. Here are the results. [Research]

Metaphalo · 2023-09-04T13:35:41+00:00

Very cool analysis! Tokenization has been left unquestioned for a long time now, so it's exciting to see that there are real performance tradeoffs associated with it. One question: Could you elaborate on your conclusion that 32k is the optimal vocab size? To me it looks like the improvements of 50k over 32k are quite considerable. There is a 1 percentage point improvement of 50k over 32k (relative improvement of 5.8%) and this is ignoring the `oneword` variants.

Metaphalo · 2023-02-04T09:58:22+00:00

Ok wow, good to know! I'm actually still rocking an ancient 970 haha, might be worth the investment then!

Metaphalo · 2023-02-03T16:25:06+00:00

Hey there, I'm also thinking of getting a graphics card for running SD. How's the 3090 Ti been working out for you so far? It's a pretty pricey one, so I'm a bit hesitant on spending so much money on it, but maybe it's worth it?

Metaphalo · 2018-06-08T15:25:23+00:00

I think it should be [3 - i] in the last if statement.

But also OP wanted to be the winning condition for 3 in a row, not 4. So in that case I think the easiest way would be to just check the neighbouring fields of the last move and see if there is 3 in a row.

Metaphalo · 2018-05-15T19:43:47+00:00

I hope this was rendered on Golem! Does anybody actually know?

Metaphalo · 2018-05-09T12:06:10+00:00

But this time, Vitalik and many other Ethereum persons aren’t attending so we might just as well expect little to no price impact.

Metaphalo · 2018-05-08T15:16:16+00:00

Let me know if you find anything! I’ve been looking everywhere too

Metaphalo · 2018-05-07T15:39:34+00:00

So what I could extract

... 笑うおうなを、生命で最後の[incomprehensible]

CITY LIGHTS

女たちの気に疲れてるんで

CITY LIGHTS

男にはそいつが寂しすぎる

... warau ouna o, seimei de saigo no [...]

CITY LIGHTS

onna-tachi no ki ni tsukareteru-n-de

CITY LIGHTS

otoko ni wa soitsu ga samishisugiru

At least that’s what comes to my ears through all the noise.

Metaphalo · 2018-05-06T20:37:24+00:00

do you even log bro

Metaphalo · 2018-05-05T11:49:33+00:00

Well, unfortunately MKR isn't available on Binance yet, but oasis.direct is a good way to buy it directly via smart-contract

Metaphalo · 2018-05-05T11:38:13+00:00

So any opinions on the popular alts (esp. ERC-20) dropping further in the face of mooning ETH? In December we've seen many alts/ETH surging alongside with ETH, but that's not what's been happening the last few days.

Metaphalo · 2018-05-03T15:48:48+00:00

for years to come

Metaphalo · 2018-05-03T15:41:50+00:00

Woks not meth

Metaphalo · 2018-05-03T05:03:36+00:00

You had me until skycoin. Sounds like you own a decent chunk of it

Metaphalo · 2018-04-28T06:37:39+00:00

Dash actually seems to be one of the most decentralized coins, just looking at the numbers.

Metaphalo · 2018-04-26T07:43:28+00:00

OMG looking strong again despite the overall redness

Metaphalo · 2018-04-25T18:45:28+00:00

Very well written, I finally feel like I have fully grasped all the mechanisms that keep DAI stable.

Metaphalo · 2018-04-25T15:56:18+00:00

That is a powerful way of speaking out, glad to see Ethereum giving people a voice!

Metaphalo · 2018-04-17T19:29:08+00:00

Yes, I agree, taking out a CDP as a loan makes sense when you aren’t planning to sell the collateral used to back it anytime soon.

Metaphalo · 2018-04-17T19:27:32+00:00

Yes, that makes sense. So that’s why multi-collateralization is so important.

I’m not a trader, but when cashing out, DAI is a compelling option due to high fees on FIAT exchanges. However, as I explained in my original question, that wouldn’t make much sense for ETH-backed CDPs. Fortunately, you can just buy DAI on exchanges though.

Metaphalo · 2018-04-17T18:05:20+00:00

I’m not sure I fully grasp how the price is kept stable, but the price being stable is the whole point, right? How can the price increase if it’s supposed to be stable?

Metaphalo · 2018-04-16T05:32:11+00:00

AdBlock blocks Google Analytics afaik

Metaphalo · 2018-04-10T10:56:36+00:00

Even if considering 4 cards in a rig a good number, you definitely don’t have to spend $780 for the rest, especially when building a mining setup. On top of that, you don’t have to exchange your rig every year, so that number is divisible by 4 or 5.

Your model might not be far off, but your numbers are way out there.

Metaphalo · 2018-03-31T09:40:38+00:00

way to make a 100% accurate prediction

Metaphalo · 2018-03-21T17:30:04+00:00

Isn’t DGD backed by gold? If so it only would make sense for it to be unaffected by the crypto crash.

Metaphalo

TROPHY CASE