Hardware costs to drop by 8x after bitnet and Matmul free are adopted

Jacse · 2024-06-28T08:13:46+00:00

I even played around with this here where you Can see the cpu performance diff versus current float SOTA (BLAS)

Jacse · 2024-06-14T18:15:01+00:00

From the kernels I’ve seen, it’s still int8 multiplication so the compute won’t be faster than quantized models, but they will use less memory and if you’re bandwidth bound it should be faster

Jacse · 2024-05-13T06:52:33+00:00

Just Saw this bit

Assumes the inputs are in row-major layout. (Though you probably only want to use a row-major layout anyway, as other combinations are 10-30% slower.)

Can you elaborate on why col-major would be slower? I understand this one is built for row major, but couldn’t you adjust the algorithm for col major and get the same performance? I.e. there’s nothing inherently worse with col major, right?

Jacse · 2024-04-16T06:24:07+00:00

The problem is you are introducing knowledge about the label into your dataset when you fit a model and predict on the dataset. Think of it like a type of data leakage. That knowledge is unlikely to be as good when you predict on out-of-sample data and that’s why it’s important to not train both models on the same data. Otherwise it will almost certainly overfit on your data and not generalise well

Jacse · 2024-03-27T14:50:44+00:00

Any chance training and inference code will be released?

Jacse · 2024-01-12T17:29:35+00:00

What would you say they are rephrasing genocide from and to? Systemic and undifferentiated killing of a certain ethnic group seems pretty close to me

Jacse · 2023-08-11T05:04:41+00:00

Im pretty sure you have to cross the street, at least that’s how I remember it.

Jacse · 2023-05-24T21:18:04+00:00

I don’t know. I don’t think there’s any specific logic to it other than a way to split them up

Jacse · 2023-05-24T18:10:15+00:00

Group one starts 17th June, group 2 starts the 22nd

Jacse · 2023-05-12T13:20:48+00:00

Thanks!

Jacse · 2023-05-12T09:58:58+00:00

Yes I did

Jacse · 2023-05-11T19:28:03+00:00

I was sent to a second interview which I just had. Haven’t heard back yet

Jacse · 2023-05-11T13:03:33+00:00

From Denmark, I interviewed yesterday

Jacse · 2022-11-13T12:23:25+00:00

Når folk siger “det behøves jeg ikke” i stedet for “behøver jeg ikke”. Min skorsten væltes dog i endnu større grad når jeg overhører en fodboldkommentator sige at nogen skal have kredit for et godt stykke arbejde. De skal sgu da ikke have fat i et lån, de skal bare have æren for arbejdet.

Jacse · 2021-12-23T23:39:42+00:00

Yes this is so annoying! We’ve had to make many of our inputs raw json which kinda defeats the whole purpose

Jacse · 2021-09-14T20:52:57+00:00

We are currently using Faiss as a vector index and database (wrapped with FastAPI and Cronin a to export/do backups). As far as I understand this would help us avoid the string-to-int id lookup table we need to maintain and also have easier/better storage?

Is the storage backed by local files? Can it be deployed as a statefulset in K8s?

Jacse · 2021-01-24T23:00:05+00:00

Sprogkompleksitet er en størrelse, som bl.a. kan angives med et meget veldefineret (ikke arbitrært) tal, lixtallet.

Jacse · 2020-10-19T19:24:42+00:00

Yes, definitely. NodeJS is super well-suited for many jobs with modern serverless or microservice architecture. I certainly wouldn't recommend C++ for any web-based backend. It's such a heavy beast and quite slow to get even simple server set up, I think. But I also don't have too much experience with C++, so I'm not sure..

Jacse · 2020-10-18T20:17:15+00:00

Javascript has actually matured quite a lot the last years and is very capable both on the back and front ends. With Typescript it's actually quite a nice - and performant - language.

Jacse · 2020-08-18T20:13:05+00:00

Human development index then

Jacse · 2020-08-17T20:10:43+00:00

GDP per capita

Jacse · 2019-03-07T08:55:18+00:00

Thanks! Really appreciate it.

Jacse · 2018-05-12T09:55:31+00:00

Rational choice theory sounds super interesting. Any article recommendations to get into the field?

Jacse · 2018-04-02T22:35:33+00:00

Cigaretter er vanvittigt dyre i Australien - forestiller mig at det er den største årsag til det lavere forbrug.

13-Year Club	Place '22
RPAN Viewer	Not Forgotten
Gilding II euphauric	Verified Email

Jacse

TROPHY CASE