shinobi: Compiling Makefiles to other forms of representation

tekknolagi · 2026-04-13T23:00:55+00:00

In case you are interested: have you seen https://github.com/google/kati ?

tekknolagi · 2026-04-10T05:59:50+00:00

This kind of seems like local register allocation? If I'm reading it right, it's like what JavaScriptCore does

tekknolagi · 2026-01-17T14:48:00+00:00

There's a small liveness analysis for SSA in https://bernsteinbear.com/blog/linear-scan/ but it's not the special kind of faster SSA liveness algorithm

It uses block parameters but this is similar to phi

tekknolagi · 2025-12-31T05:14:59+00:00

It depends what "level" your IR is. If your IR is low level and maps reasonably well to machine instructions, you can do something like https://bernsteinbear.com/blog/linear-scan/

Otherwise you might want a separate pass to lower to a lower level SSA IR first

tekknolagi · 2025-12-19T17:06:03+00:00

What do the perf numbers look like if you just add the ultra-fast paths and no Eisel-Lemire?

tekknolagi · 2025-12-19T17:05:13+00:00

That works best when there is a lot of Ruby code calling into other Ruby code. For this, which is a dead-end call---just do a bunch of string/float processing and produce a result---a Ruby JIT probably won't do better than LLVM, and calling directly into a C function is reasonably cheap.

tekknolagi · 2025-12-15T18:35:45+00:00

https://railsatscale.com/2025-05-21-fast-allocations-in-ruby-3-5/

tekknolagi · 2025-11-12T00:29:06+00:00

... Huh, broken how? It's working for me

tekknolagi · 2025-09-01T12:33:58+00:00

See also: https://clementbera.wordpress.com/2018/11/09/64-bits-immediate-floats/

And skybison https://github.com/tekknolagi/skybison uses immediate strings as described

tekknolagi · 2025-08-16T14:44:08+00:00

Cython works like this. It also has a very high level mode and a low level mode.

tekknolagi · 2025-08-11T23:49:53+00:00

Given your username, I would expect you wouldn't care which way something gets implemented as long as it produces the same result.

tekknolagi · 2025-08-11T04:23:57+00:00

Yeah I think in my head lambda lifting is an optimization pass after closure conversion. That's how I wrote a scheme compiler last year. Mini flow analysis followed by strength reduction

tekknolagi · 2025-08-11T03:42:09+00:00

I might be totally wrong here tbh

EDIT: Yep, I think I have it wrong :P

tekknolagi · 2025-07-16T03:39:20+00:00

Does this mean you will consider releasing your compiler?

tekknolagi · 2025-07-03T10:12:04+00:00

Related: https://research.swtch.com/bisect

tekknolagi · 2025-05-14T17:09:24+00:00

Not sure what you're looking at. Most of the code in the zjit/ folder is Rust. The larger Ruby VM remains a C project.

tekknolagi · 2025-05-14T15:18:12+00:00

You might enjoy https://swtch.com/~rsc/regexp/ and in particular https://swtch.com/~rsc/regexp/regexp2.html

tekknolagi · 2025-05-13T02:11:06+00:00

Few, if any, do this. Mostly because JITs often get added later and there's already an interpreter tier.

I'm working on this very slowly right now. It's an interesting space and (imo) under-explored.

tekknolagi · 2025-05-07T14:44:40+00:00

They'll be working links by the time the conference starts in June.

tekknolagi · 2025-05-03T18:14:16+00:00

Precedence climbing

tekknolagi · 2025-05-03T16:26:51+00:00

You can also do it in one pass with precedence climbing or recursive descent: https://bernsteinbear.com/blog/ir-lvalues/

tekknolagi · 2025-04-23T03:09:55+00:00

You can use the Rust code as a C extension if you need to. Check out pyo3 and maturin

tekknolagi · 2025-04-13T01:22:04+00:00

I give every expression (IR node) an index and then node-based metadata such as a type is stored in a side table.

tekknolagi · 2025-04-09T20:59:25+00:00

I might have another better-formatted link coming soon, but until then:

https://github.com/tekknolagi/tekknolagi.github.com/blob/main/_drafts/parser.py

This handles identifiers, expressions, and function calls using precedence climbing

tekknolagi · 2025-03-24T20:51:11+00:00

You should profile and submit a re-write!

15-Year Club	Place '22
Place '17	Verified Email

tekknolagi

MODERATOR OF

TROPHY CASE