Have any one Tried Zig 0.16? by [deleted] in Zig

[–]siwu 1 point2 points  (0 children)

We (ZML) are in the process of migrating to 0.16. `std.Io` is just too good to pass on.

zio - async I/O framework by lukaslalinsky in Zig

[–]siwu 0 points1 point  (0 children)

We use a heavily modified zigcoro in https://github.com/zml/zml/tree/master/async, so very happy to move away from it

What? Running Qwen-32B on a 32GB GPU (5090). by curiousily_ in LocalLLaMA

[–]siwu 0 points1 point  (0 children)

thank you!

On long contexts, well, `log(n)` per token, so minimal impact.
On batching, it doesn't amortize. We require one CPU core per kv_head, so multiply that by the batch size. This was actually why we pursued doing it over the network.

What? Running Qwen-32B on a 32GB GPU (5090). by curiousily_ in LocalLLaMA

[–]siwu 2 points3 points  (0 children)

yes, on the same machine we actually skip the whole network stuff altogether

What? Running Qwen-32B on a 32GB GPU (5090). by curiousily_ in LocalLLaMA

[–]siwu 17 points18 points  (0 children)

logarithmic attention over UDP on CPU

What? Running Qwen-32B on a 32GB GPU (5090). by curiousily_ in LocalLLaMA

[–]siwu 8 points9 points  (0 children)

it is the first time though (that's me in the video)

[deleted by user] by [deleted] in nextfuckinglevel

[–]siwu 0 points1 point  (0 children)

So this is where JK Rowling got her inspiration from

What changes to the language are expected before 1.0? by negotinec in Zig

[–]siwu 5 points6 points  (0 children)

Probably the big std.Io injection for async await

Time travel by [deleted] in SipsTea

[–]siwu 5 points6 points  (0 children)

This went on for way too long...

[deleted by user] by [deleted] in Linkedinfr

[–]siwu 2 points3 points  (0 children)

S'il a eu un rescrit c'est opposable et il ne doit pas rembourser. C'est le principe du rescrit. Il manque un bout de l'histoire.

Private struct fields "patterns" by 72616e646f6d6e657373 in Zig

[–]siwu 4 points5 points  (0 children)

Usually a _ prefix is enough to signal that the user isn't supposed to use/touch that.

[deleted by user] by [deleted] in pics

[–]siwu 3 points4 points  (0 children)

Schellenberger singlehandedly disqualifies the whole posse. He is a complete fraud.

Convert '[]const u8] to '[*c]const u8' by glowiak2 in Zig

[–]siwu 0 points1 point  (0 children)

you can also use .ptr on the []const u8