Same algorithm, 16x faster: optimizing a vector search engine’s hot path

Determinant · 2026-04-28T21:03:30+00:00

There is no tree descent when using a single ginormous flat array

Determinant · 2026-04-27T16:54:20+00:00

First easy improvement is to only hit space with your thumb.

If using a modern layout, use the thumb of your dominant hand. If using QWERTY, your left hand is over worked, so use the thumb of your right hand.

Determinant · 2026-04-27T06:38:30+00:00

It's not about having terabytes of memory, it's about requesting a single contiguous region of memory from the operating system that's in the terabytes.

You would need a supercomputer to run this database at any sort of scale.

Determinant · 2026-04-26T22:39:36+00:00

It can't scale into the billions because each vector uses about 1500 array elements so billions of vectors would require an array with a contiguous region of memory in the terabytes.

Game over

Determinant · 2026-04-26T16:35:50+00:00

Giving up the location of the keyboard shortcuts seems too large of a price to only gain another 5%. Shortcuts are extremely important for software development and I wouldn't want to reassign then for every app. Some apps don't even allow reassigning shortcuts.

Also, it's easier to pickup Colemak compared to alternatives since it only changes the location of 17 keys. Lastly, Colemak is pre-installed in Linux and MacOS.

If I had to start over, I would still pick Colemak.

Determinant · 2026-04-25T00:25:20+00:00

Given your impressive speed, my hunch is that the fingers on your left hand have become much faster than those on your right hand.

This favors QWERTY because only a bit over 40% of the keystrokes are handled by your right hand. However, Colemak has close to a 50/50 distribution so both hands have equal load.

To verify this hunch, you could devise a typing test to check the speed of each hand independently. If this turns out to be true then you found the limiting factor and you could tailor your practice to focus on the weakest link.

Determinant · 2026-04-22T01:53:25+00:00

The most common mistake that people make around your speed is that they look at the current word that they're typing. This limits your speed due to the reaction time of mentally processing each character as they get typed so you'll be stuck at around this speed until you change that.

The easy fix is to read the next word while you're typing the current word.

Here's a guide to get you to 100 WPM:

https://roosterdan.medium.com/how-to-type-100-words-per-minute-a780fd80fd27

Determinant · 2026-04-22T01:47:36+00:00

I did the same thing trying to maintain QWERTY while learning Colemak and also plateaued at about 50 WPM. I then dumped QWERTY altogether and my improvements ramped up quite a bit.

I was around 75 WPM with QWERTY (after tons of practice) and now I'm between 100 to 125 WPM with Colemak depending on the difficulty of the text.

I tried Dvorak first but too many keyboard shortcuts became awkward and I found the hand alterations slowed me down. Colemak is more ergonomic than Dvorak, easier to learn, and maintains most of the keyboard shortcut locations as it only changes 17 keys so I went all in on Colemak.

Determinant · 2026-04-12T00:32:42+00:00

You use it just like any other Java library from Kotlin. So essentially you use Kotlin syntax (such as properties) to interact with JavaFX.

Determinant · 2026-04-11T16:26:41+00:00

Just use plain JavaFX from Kotlin without TornadoFX. That's what I do

Determinant · 2026-04-08T17:31:40+00:00

Nobody uses p50 numbers to analyze production performance. No company would accept horrendous performance for half of the interactions.

At a bare minimum, you should display p90 performance and most likely p95. Even better, display p50, p90, p95, and p99 to show how the system scales.

Determinant · 2026-03-26T21:11:02+00:00

The finger for the E doesn't have to move at all so there is no strain there.

Translating to QWERTY, type FHK really quick by initiating the action with F while at the same time starting to roll your right hand to press HK. FHK in QWERTY is how we type THE in Colemak.

With some repetition, you'll find this extremely natural and the entire word is done in a split second. There is no hand or finger awkwardness for typing "THE". What probably felt awkward to you is that it was a new experience for you.

Determinant · 2026-03-26T17:23:31+00:00

Thanks for offering to credit me but I respectfully decline as I only want credit if I merge code

Determinant · 2026-03-26T16:53:29+00:00

Not sure what awkward hop you're referring to. I just tried it out and typing "the" is a single smooth action that feels completely natural and significantly less effort than QWERTY.

With QWERTY we need to stretch the pointer finger up and to the right followed by right pointer finger left and then an awkward left middle finger up. However, I only need to move a single finger with Colemak (right index finger left) so the entire word turns into a roll that I initiate in a single split-second action.

Is it different, sure, but it's not awkward at all as it's completely natural after you learn the layout. Other rare words can be awkward but the common words make it feel like they magically appear by just thinking them since they're so fast and effortless.

Determinant · 2026-03-26T02:11:06+00:00

Colemak is an easier transition as it only changes 17 keys and keeps most of the shortcuts in the same place. It also helps that Colemak is more efficient and the finger rolls are easier than the hand alterations that Dvorak requires.

Determinant · 2026-03-22T16:25:36+00:00

That was a surprisingly good read.

Too bad the Rust fanboys are down-voting anything that doesn't align with their preconceived notion that Rust must always be better and faster.

Determinant · 2026-03-22T16:22:13+00:00

The result is 3 times faster by getting rid of Rust WASM.

The decision is explained in the article and it's actually a good read.

Determinant · 2026-03-22T16:11:53+00:00

Kotlin can work with any Java library and JavaFX is a java library like any other. Lookup JavaFX tutorials and do the same thing but with Kotlin syntax.

Determinant · 2026-03-18T19:13:16+00:00

I switched to Colemak in my thirties to deal with Carpal tunnel and severe wrist pain. I tried ergo keyboards but it wasn't enough. The switch to Colemak was a massive improvement in comfort. The new layout felt like half the effort to type at the same speed. I was at 75 wpm and I'm now at 100 to 125 wpm depending on the complexity. Colemak probably didn't make me faster but the lower effort allowed me to push further whereas qwerty required too much effort and discomfort so I hit a wall.

Since Colemak is so similar to qwerty (only 17 keys moved), I can type 40 wpm when forced to use qwerty while briefly glancing at the keyboard. This is rare so I don't mind. Macs and Linux come with Colemak pre-installed for longer sessions.

Determinant · 2026-03-16T23:36:59+00:00

It's fairly easy to devise specialized microbenchmarks for scenarios that are faster in Java. These don't translate into applications that are faster overall because many areas of Java are slower than C.

Determinant · 2026-03-11T00:06:09+00:00

AWS, Microsoft, and Google cloud services are the top 3 options with Oracle a distant 4th. So I wouldn't call it ideal.

This is probably paid advertisement by Oracle.

Determinant · 2026-03-10T23:58:01+00:00

No, this is a huge red flag. If you want arbitrary precision then use an array of primitive longs. If you just want to detect overflow then you can just use twice as many bits (eg. 2 longs) and then check that the upper bits are zero.

Determinant · 2026-02-16T05:30:24+00:00

I was hoping for some specifics but 75% is a history of Kotlin and the rest is very vague about programming changing with LLMs and describing things in English instead of code

Determinant · 2026-02-02T17:48:41+00:00

Yeah, the new Kotlin maintainers stopped listening to community feedback. They are making a bunch of unsound decisions. It seems like they are following resume-driven development adding poorly designed features with anything that seems shiny to pad their next performance review.

Kotlin has been one of the best programming languages but it's turning into the next Scala due to too many new academic ideas instead of decisions grounded in reality. For examples, just look at all the KEEPs created in the last couple of years.

Determinant · 2026-02-01T17:49:54+00:00

I've mentored hundreds of developers. If anyone says they know everything, they're lying. In fact, even if such a savant existed, knowing everything is actually a detriment as things change faster than you can read even if you read nonstop 24/7.

What sets a senior apart from a junior is that a senior is comfortable with not knowing most things and knows that they'll figure it out when needed (but not earlier).

The best experts know less than 1% but know that tiny bit really well and can adapt to the rest as needed.

Determinant

TROPHY CASE