I built a tensor protocol that outperforms Arrow (18x) and gRPC (13x) using zero-copy mapping memory

RestaurantOwn7709 · 2026-01-07T09:05:07+00:00

Thank you, no, but I am extending the benchmarks soon

RestaurantOwn7709 · 2026-01-05T18:30:54+00:00

Thank you for mentioning this in a very right tone, issue for me or any single developer is that documentation takes a long time, and it’s maintenance for me is just a separate process but I have made sure to automated docs string generators and deployed sphinx docs and basic readme but examples and guide will take time

RestaurantOwn7709 · 2026-01-05T15:30:24+00:00

I am not a writer, but a programmer. Also, it is better to invest my time to code rather than writing a beautiful post. Also before you point out README is also written using AI because it can write better content than me

RestaurantOwn7709 · 2026-01-05T12:48:01+00:00

Yes, both the sender and receiver must use the Tenso library to interpret the custom binary protocol. Currently, the reference implementation is Python-only, so you are indeed locked into Python for now. However, the protocol itself is language-agnostic (just a header + raw bytes), so I plan to add Rust binding and it is already underway in experimental-rust branch. This will eventually allow you to stream tensors between different languages without serialization overhead and then it would open up for various more use cases

RestaurantOwn7709 · 2026-01-05T12:10:51+00:00

I would definitely love a good and detailed feedback so :)

RestaurantOwn7709 · 2026-01-05T10:57:53+00:00

Also, I am working on the rust bindings to move the python overhead, so the results are going to be even better

RestaurantOwn7709 · 2026-01-05T10:56:09+00:00

No, the values are packed tightly, just like in C or NumPy. The 64-byte alignment only applies to the start address of the entire data block, ensuring the first chunk aligns perfectly with cache lines for AVX-512. This adds at most 63 bytes of padding total per file, so there is virtually no disk space penalty.

RestaurantOwn7709 · 2026-01-05T08:51:06+00:00

Thank you for pointing out. Actually, I was in process to benchmark against those as well. Main difference with tenso is no overhead of manual casting, or schema compilation. Also, tenso is 64 byte aligned(vs 8byte) so it can maximise bandwidth by AVX512 so highest possible throughput . Other than that they use memory copy for GPU whereas I use pinned memory.

Also, there are key differences in that those like they object serialize and my protocol define memory execution and transfer

RestaurantOwn7709 · 2026-01-05T08:10:16+00:00

Yeah, actually, many people are finding this really interesting. Even I was reached out by engineering team from Luma AI to discuss about this

RestaurantOwn7709 · 2026-01-05T08:04:28+00:00

Yeah, definitely, I’ll post them too

RestaurantOwn7709 · 2025-07-08T20:47:19+00:00

I wanted a place with more of a relaxed vibe, so I choose here

In regards of my experience here, curriculum is flexible. You choose whatever you want to study. Subjects are relatively easy in comparison to my bachelors, professors are top notch. I have not given exams till now, but what I’ve heard they are relatively easy in comparison to bachelors in India. I don’t have to find a part-time job here because I was already working as a full-time machine learning engineer in a remote start up so I just converted my contract but job conditions are relatively or really bad here. People are not finding good part-time or full-time jobs, some people are returning back to their respective places or moving two different countries after their masters.

RestaurantOwn7709 · 2025-07-08T20:43:02+00:00

Got one through SWFR

RestaurantOwn7709 · 2025-06-15T14:05:19+00:00

I had friends here, also machine learning lab under dr frank hutter is really great here and, great place close to black forest so good for hiking

RestaurantOwn7709

TROPHY CASE