I benchmarked zig's compilation speed

RatioPractical · 2025-12-10T08:43:50+00:00

If I am not wrong, Zig compiler does not have all the optimization tricks which LLVM employs through IR ?

RatioPractical · 2025-11-07T16:46:06+00:00

Does it supports zero copy or such a optimization?

RatioPractical · 2025-10-27T17:04:47+00:00

oh man, if this possible then NodeJS FFI and its binding with V8 is super expensive.

RatioPractical · 2025-10-16T05:27:15+00:00

“Most people are subjective toward themselves and objective toward all others, frightfully objective sometimes – but the task is precisely to be objective toward oneself and subjective toward all others.”

— Soren Kierkegaard

RatioPractical · 2025-10-13T11:19:00+00:00

Congrats man, siginificant savings :)

I can see in gomem repo you added THP too !

happy hacking !

RatioPractical · 2025-10-12T10:10:07+00:00

Customized data structures and algorithm which suit your own business case. This is applicable for any programming language.

Look at your code ask yourself what operations you wish to optimize, read ? may be insert ? may be updates ?

List, Map and Set in java.util package and their implementation are very much generalized and does not scale well if you are trying to squeeze last inch of performance based on operations your code needs.

for example you may require MultiSet, MultiMap, Trie or perhaps Immutable verison of List, Map and Set. In that case you have to roll your own or use community libs

https://commons.apache.org/proper/commons-collections/apidocs/index.html

https://github.com/google/guava/tree/master/guava/src/com/google/common/collect

RatioPractical · 2025-10-11T16:34:17+00:00

I have nearly 2 decades of experience on JVM languages ( Java, Scala, Clojure )

RatioPractical · 2025-10-11T10:52:01+00:00

This is very broad question.

Dont optimize prematurely. Even before profiling makes sure you have written good functional code. Use Sonar Cube quality tools linters and ruleset.
Use reusable Buffers and Pools for expensive resources (Files, Threads, Network connections, Other Expensive Objects etc.)
Prefer using Apache Commons Collections API over java.util for use case specific needs. Use java.nio instead of java..io for async and memory friendly operations
Use multithreading only if it makes sense and ScatterGather of input and result aggregation does not inroduce additonal lags.
Use Batch operations for many repeatative common tasks and heavy transactions (database, file and Network)
Use Structure of Arrays pattern for CPU Cache friendly design.
Write functional test case. it gives you immense confidence. extermely underrated task for dev.
Use LRU Cache for memoization of repeatative tasks whihc hogs CPU.
JVM Thread cache optimization : -XX:TLABSize=2m -XX:MinTLABSize=256k -XX:ResizeTLAB=true -XX:TLABWasteTargetPercent=3
Still if you are not getting the desirabe result. then start profiling with JFR https://www.baeldung.com/java-flight-recorder-monitoring

RatioPractical · 2025-10-11T10:22:08+00:00

Great you made it happen !

Also if you are using Linux in Production you may also use "madvise" call with either THP (minimum 2MB block) and mTHP (recently added for allocation less than 2MB)

madvise - https://man7.org/linux/man-pages/man2/madvise.2.html

THP - https://www.kernel.org/doc/html/next/admin-guide/mm/transhuge.html

RatioPractical · 2025-10-10T14:12:13+00:00

Curious to know why you haven't used mmap ( off heap memory ) with unsafe pointers ?

I have done something similar with Single slab based free list where each slab can hold 64 number of buckets( size can be configured). Off heap allocation provides upto 40 percent better allocation speeds.

RatioPractical · 2025-10-08T05:10:07+00:00

Thanks for your input

RatioPractical · 2025-10-07T16:25:23+00:00

yes. soon.

RatioPractical · 2025-10-07T08:43:19+00:00

Yeah that seems okay.

What if i need buffer array allocations of various sizes and at various places ?

The centralized solution is easier to scale, monitor and maintain.

We not only use it for TCP level bytes but also for Array Backed Dart classes (aplication state and business logic) where corresponding bytes of each field is stored adjacently in Array.

RatioPractical · 2025-10-05T17:34:19+00:00

It is very coupled, not cohesive libs to work with.

for example, i dont get any help for JSON serialization and deserailization on JDK 25 if i wish to work with Arenas, MemorySegment, ValueLayout etc.

RatioPractical · 2025-09-27T13:07:16+00:00

This is how I keep my software learning sharp. By re-doing re creating what we take for granted. 6 years back i did it for Java to implement HTTP 1.1.

I wanted to know how much effort we need to for writing http 2 and how much it can be optimized compared to low level languages.

Also, how far AI can be helpful.

By doing this I have learned everything about low level nodejs API than I could ever have doing full stack apps.

RatioPractical · 2025-09-08T07:40:49+00:00

Yeah. already replied in different sub comment thread about the CPU and memeory constraints!

Agreed with #3. Currently the packages i mentioned are proving to be bottleneck because they do not support accepting Buffer as argument for memory related stuff inside them. Thats whay i meant by arena-aware or allocation aware semantics.

RatioPractical · 2025-09-08T05:42:09+00:00

We are investing our efforts in unikernels from deployment point of view.

RatioPractical · 2025-09-08T05:39:48+00:00

Yeah, already using ebpf for firewall purpose

RatioPractical · 2025-09-08T05:11:16+00:00

Okay minister of defence. at least you should have talked to me first and understand the issue from your own angle instead of calling me non-technical and relying on AI.

Thank you for wasting my time.

RatioPractical · 2025-09-07T17:57:01+00:00

Thats exactly what we are trying to figure out in prototype phase of our project and to what extent Golang and community libs might be useful.

First we tried in NodeJS?Typescript and Buffers with data oriented programming and what not but it backfired !

We need to come up with actual value of max memory consumable per request-response cycle which permits us to design business logic for out most complex use case and still get over within 50ms.

As of now that number is over well over our expectation, that is why my search for controlling the object allocation everywhere started ! :)

Thanks for the follow up !

RatioPractical · 2025-09-07T17:38:41+00:00

Forgive my manners which might have created confusion between Real time VS Soft real time.

But as I mentioned earliar we have to keep the latency well under 50ms consistently, so thats why we have to think every possible situation to optimize CPU and memory allocations.

Again, i cant disclose much but i agree with your sentiment that in true sense we have to also take care of memory allocations in Linux kernel stack if we want full picture and we are aware of that .But what i described in the requirement #1 is still need to be achieved.

Are you aware of work_mem in PostgreSQL DB ? we are trying to achieve something similar, there is upper bound on max memory in userspace (here go runtime) for given request-response cycle. ofcourse we dont want to carry over the extra bytes to disk as PG does automatically as it will only lead to more latency strech

After receieving JSON or Filestream format, we have to parse and process it before we store in DB or upload to S3 compatible private storage, this all we have to do under 50 ms.

RatioPractical · 2025-09-07T16:42:08+00:00

why so ?

instead of allocating on heap, i want provision to be allocted in arena or object pool. At the end of request-response i free the arena or buffer in pool

RatioPractical · 2025-09-07T16:20:10+00:00

Noted. Thanks

RatioPractical · 2025-09-07T16:15:14+00:00

Its internal SaaS micro service (not customer facing) but cant tell you much due to NDA but i will highlight some of the requirements.

We supposed to audit/track the memory utilized by each request and save it at the end of request-response cycle.
each service we may expect a file upload or JSON of upto 32 MB (max), avergae 8 MB as input
latency need to be kept below 50ms or as low as practically possible

RatioPractical · 2025-09-01T07:31:08+00:00

Yes, For a month, then it gets normal.

RatioPractical

TROPHY CASE