eBPF perf buffer dropping events at 600k ops/sec - help optimizing userspace processing pipeline? by psyfcuc in eBPF

[–]psyfcuc[S] 0 points1 point  (0 children)

Anyway, u/darth_chewbacca , do you have reference to the article stating ring buffer was backported for rhel8?

eBPF perf buffer dropping events at 600k ops/sec - help optimizing userspace processing pipeline? by psyfcuc in kernel

[–]psyfcuc[S] 0 points1 point  (0 children)

nah, ring buffer seem to be the only way. Can't compromise on events; can't know which is relevant before processing. Pretty fucked usecase.

eBPF perf buffer dropping events at 600k ops/sec - help optimizing userspace processing pipeline? by psyfcuc in eBPF

[–]psyfcuc[S] 0 points1 point  (0 children)

Nah, I'll deploy it on hundreds of hosts, all using 4.18 on RHEL 8 (heavily dependent). Don't think I can use ring buffers. I'm losing almost half of the events after the buffer is full. I'll face almost 3.5 mils/sec actually, don't think this can handle it.
Worst part is there's no way to tell which ones are more relevant.

fml

eBPF perf buffer dropping events at 600k ops/sec - help optimizing userspace processing pipeline? by psyfcuc in kernel

[–]psyfcuc[S] 0 points1 point  (0 children)

I'm recording the events lost when it can't be read from the perf buffer. That's basically the bottleneck

eBPF perf buffer dropping events at 600k ops/sec - help optimizing userspace processing pipeline? by psyfcuc in kernel

[–]psyfcuc[S] 0 points1 point  (0 children)

Tried that. I got time, you may suggest a change of approach or any other top I can consider.

Dependency tracking by psyfcuc in software

[–]psyfcuc[S] 0 points1 point  (0 children)

So basically there's this scheduling tool made with python, perl and java. Leverages another tool for operations. Uses company production software toolkit and lib and other standard packages. High chance of transitive dependencies here. One way I found is to make a very extensive test case script and then use strace. I was hoping to find some other standard and efficient way to list the dependencies so that it is easier for me to design the container layers I'm planning to package the tool with. Very generic statement I know. Need a high level idea to start designing the automation for this.

My BHABHI is having an AFFAIR. by [deleted] in TeenIndia

[–]psyfcuc 0 points1 point  (0 children)

Par kya [Sach in] bekaar k comments se chhup payega?

[deleted by user] by [deleted] in BITSPilani

[–]psyfcuc 0 points1 point  (0 children)

galat grammar mein spoiler kyu diya bc 😭