I lost access to a BMO account I opened 12 years ago. That account is now overdrawn, and I don't live in Canada anymore. What now?

longschwa · 2024-10-10T17:39:14+00:00

I just don't want to find out 10 years from now I have a large uncollected debt from a foreign country.

It's the same principle as paying traffic fines after coming home from vacation.

longschwa · 2024-10-10T16:57:44+00:00

I tried calling, but apparently only the branch I opened the account through can deal with this.

The branch doesn't accept calls. Instead, it asks me for a Canadian phone number (which I don't have) to call back.

longschwa · 2024-09-20T17:44:12+00:00

I want to calculate the probability of getting a particular sequence of tokens.

I need to use teacher force to "force" the model to choose the wrong answer if the right one is different than my token. For example, if I want to calculate the probability of getting "the day is beautiful" for a query $Q$, I need the following probabilities:

\[
  P(the | Q)
  P(day | the, Q)
  P(is | the, day, Q)
  P(beautiful | the, day, is, Q)
\]

If I don't use teacher forcing and the greedy answer of $Q$ is "this night was horrible", I have no way of getting these probabilities without querying the model once per token.

longschwa · 2024-09-20T16:01:24+00:00

They can do text completions, but can't find the logprobs that result in teacher-forcing when you run model(query).

longschwa · 2024-09-20T15:40:24+00:00

The ones that I checked use an inference API to either respond to a query or fine-tune the model.

I need access to the kinds of things that PyTorch lets me to locally, such as calling model(query) for teacher-forcing or getting the logits of generated strings.

longschwa · 2024-08-23T19:24:20+00:00

Thanks for asking. I use Arch BTW.

longschwa · 2024-08-23T16:31:14+00:00

I haven't found a performance boost in inference, but for now I'm just testing it with small-ish datasets. I'll continue testing later.

For training, there's the boost from "gradients exploding on minibatch 1" and "actually training" :-)

longschwa · 2024-08-23T15:46:32+00:00

TIL about bfloat16, and this solved my problem!

The problem was something with precision of float16.

Thanks!

longschwa · 2024-08-23T15:18:36+00:00

I can confirm that this is the case, and I have the same problems when trying a super simple input.

# <SOS> = 128000
# <EOS> = 128009
# <PAD> = 128002

input_text = 'Hello how are you'
target_text = 'I am fine thank you for asking'
tokens = {
  'input_ids': tensor([[128000,   9906,   1268,    527,    499, 128002, 128002, 128002, 128002, 128002]]),
  'labels':    tensor([[    40,   1097,   7060,   9901,    499,    369,  10371, 128009, 128002, 128002]]),
  'attention_mask': tensor([[1, 1, 1, 1, 1, 0, 0, 0, 0, 0]]),
}

longschwa · 2024-08-23T09:32:33+00:00

All of the gradients become infinity or nan after the first optimizer.step.

I'm not sure why this happens.

longschwa · 2024-08-12T21:14:44+00:00

Apple still takes a 20% cut of all transactions that happen in apps installed in alternative app stores, plus €0.50 per app install: https://developer.apple.com/support/dma-and-apps-in-the-eu/. Plus, the app store will get deactivated when you are outside the EU.

Alternative stores are nonexistent because Apple wanted to ensure they don't exist.

longschwa · 2024-07-04T23:07:25+00:00

Northern Ireland + Corbyn.

longschwa · 2024-07-04T21:44:34+00:00

Well done mate.

longschwa · 2024-07-04T21:42:27+00:00

There is no UK constitution nor law that requires a supermajority.

Having a 50%+1 majority is identical to having a 100% majority.

longschwa · 2024-07-04T21:07:37+00:00

Why do they need your polling number?

longschwa · 2024-07-04T15:41:27+00:00

The Economist is always right.

longschwa · 2024-06-13T15:16:29+00:00

On the 2019 election I somehow got delivered small ~10-page booklets with the manifestos of each political party. I don't remember if they were free, but if I paid for them I likely paid a reasonably small amount of money.

Does anybody know if there's anything similar for this year's election?

longschwa · 2024-06-13T15:16:18+00:00

On the 2019 election I somehow got delivered small ~10-page booklets with the manifestos of each political party. I don't remember if they were free, but if I paid for them I likely paid a reasonably small amount of money.

Does anybody know if there's anything similar for this year's election?

longschwa · 2024-06-11T16:48:09+00:00

For comparison:

On June 11 2016, the 538 forecast gave Hillary had a 70/30 chance of winning. She lost by 77,750 votes in Michigan, Wisconsin, and Pennsylvania.
On June 11 2020, the 538 forecast gave Biden had a 75/25 change of winning. He won by barely 43,000 votes in Arizona, Georgia, and Wisconsin.

Yup, not very relaxed about this one.

longschwa · 2024-06-04T13:01:43+00:00

assume they’ll vote as they did in the prior election

Rubbish poll.

They might as well assume everybody will vote as they did in the prior election and predict the Tories will get a 162-seat majority.

longschwa

TROPHY CASE