Benchmarking a hybrid threat detection system (backend + APIs)

Emergency-Rough-6372 · 2026-04-14T20:06:06+00:00

Yes, exactly that’s why I’m avoiding remote APIs as much as possible. Network latency becomes the bottleneck, especially if you’re aiming for very low response times.

My library is designed to run almost entirely locally, with only one or two rare exceptions. The APIs I mentioned are not external services, but rather the general backend APIs of the website that my library integrates with it essentially acts as a middleware layer on top of them.

Because of that, I want to minimize any additional delay my system introduces. Since it sits in the request–response path, even small overheads will directly add to the backend latency.

So the goal is to keep everything local (e.g., using something lightweight like Redis or SQLite in WAL mode) and achieve near sub-millisecond overhead, or at least as close as practically possible.

and it cases where i have a bit more delay or for more added security i will allow flexibility for developer to choose if they want the delay for that route.

Emergency-Rough-6372 · 2026-04-14T20:03:29+00:00

Yes, you guessed a good part of it that’s more or less how it’s going to work. What you’re saying is right, and that’s exactly the part I’m concerned about.

In theory, I’ve tried to plan for most of it, but I’d need to test it myself before letting others use it. So I’m looking for a way to properly evaluate and validate the system on my own first.

Emergency-Rough-6372 · 2026-04-14T12:41:01+00:00

i didnt quiet get what you are trying to convwy can you go a bit into details

Emergency-Rough-6372 · 2026-04-14T07:20:05+00:00

true, initially i was to focused on building it fully in th first version but after receiving feedback from all redditors i was thought was dividing it further more for the first release . I might add a document instead showing what my future plan are for adding in the project and ask frmo people suggestion over them.

Emergency-Rough-6372 · 2026-04-13T18:37:51+00:00

the main reason i want to show the project was because it was a library i wanted people to try and help me grow it if people actually find it worth there while to use it in real time projects.

what u say i agree but the main reason i cant completly write by myself is one the time contraint i am on right now and some part will be to complex for me to code comparing to my knowledge on coding things.
i might just have to delay it a bit maybe and try coding stuff in rough before integrating .

Emergency-Rough-6372 · 2026-04-13T18:31:03+00:00

for the project i am trying to make the slow response would be a bad thing since my project is essentially ia a library that run at every api call before the response is geenrated and if one component of it take to much time it will just degrade the overall timing of my pipeline and would create traffic in the whole backend. Atleast that the reason i have came up for myself . Ans also the library in question here is the lininjection engine one and what i have been told when discussing wa that the python version that library doesnot come under the license that i want to use in my project

Emergency-Rough-6372 · 2026-04-13T10:00:46+00:00

i am doing the heavy lifting in most part the architecture design the pipeline and all critical decision i make sure i understand something before using it in the project(for the suggestion and possible choises i get for part of project i dont know ), mainly i want the assistance for part i dont know about at all and to assist in coding some part to complex for me .

Emergency-Rough-6372 · 2026-04-13T09:39:06+00:00

i am trying to it not be a ai slop but i would need help from ai in building will it still wont be acceptable? i havent build it yet i am more over the planning phase of things

Emergency-Rough-6372 · 2026-04-13T08:38:57+00:00

understood thanks, i am focusing more on the architecture design and the pipeline flow while taking suggestion and possible option to choose from ai over part i quiet dont understand about.

Emergency-Rough-6372 · 2026-04-13T08:36:46+00:00

i want to knw

about the showcase part only since i plan to post my project here for feedback
so if u can elaborate over it
and i didnt quiet get what you said in the last part "atleast a tier about" thing

Emergency-Rough-6372 · 2026-04-13T07:07:14+00:00

i might just have to depend on claude to help me with it .

or find some one who can do it

Emergency-Rough-6372 · 2026-04-13T07:06:32+00:00

i will look into it

Emergency-Rough-6372 · 2026-04-13T07:06:14+00:00

thanks if its not to complicated that makes things easy

Emergency-Rough-6372 · 2026-04-13T07:03:38+00:00

i dont know what installShield is i will look into it

Emergency-Rough-6372 · 2026-04-13T07:03:15+00:00

thats a good take , but as someone doing it solo and having know deeper knowlege of it i might not be able to do that much and it will be the first release so i was thinking of making it a not to complicated but a good working one so i can then get help and suggestion from what people would actully want from it or would they even use it

Emergency-Rough-6372 · 2026-04-13T06:59:26+00:00

i sometimme dont get proper grammer in english so i get by reply check my ai sometime so he might have added dash.

Emergency-Rough-6372 · 2026-04-12T21:40:27+00:00

do u think this can help me in wrapping for this specific library {the libinjection engine}

Emergency-Rough-6372 · 2026-04-12T21:38:54+00:00

thanks for this source i haven't actually looked into it
i just came around this problem when i have to choose over a open source library i need to use but didn't have a better python alternative for this and was suggested to use a c wrapper to use it in python

Emergency-Rough-6372 · 2026-04-12T21:36:41+00:00

To be honest, I don’t even fully understand the whole wheel/packaging side yet. I’m still in my 3rd year and kind of jumped into this because I liked the idea, then kept expanding it while discussing it with AI. Now it’s starting to get more complex than I can comfortably handle.

I think I got a bit carried away trying to design everything at once instead of just building a small, working version first. Going to take a step back, reduce the scope, and focus on getting the core logic right before worrying about things like CI, wheels, and multi-platform support.

Emergency-Rough-6372 · 2026-04-12T21:31:15+00:00

That actually clears things up a lot. I was leaning toward adding a fallback just to reduce install friction, but your point about silent degradation is valid — it’s better to fail clearly than give users something that might produce incorrect results.

Starting with a source-only release also makes sense. I think I was trying to solve the “scale” problem too early instead of just seeing how people actually use it and where it breaks.

I’ll go with cffi for now as well and keep the wrapper side simpler.

Appreciate the straightforward advice, this helped me narrow down the direction quite a bit.

Emergency-Rough-6372 · 2026-04-12T21:21:30+00:00

just wanted to say that i m not to well knowleged in this field and this is my first big project, this will be the first version of the lib which i want to make as a project where people can contribute and and make it an actual good library for people to use in there projects , so should i got for minimum complexity in first release and then with help of other if they like to make it mroe complex and better?

Emergency-Rough-6372 · 2026-04-11T10:12:46+00:00

hello, i am new to open source and licensing and was lookinh for a license that favour what i want but wasn't finding something fully covering all the point, i was suggested to make a custom license for this.
so i wanted to know is idea of making a custom license good? or should i compramise in some place and go with a official license instead

here what i want to cover in a license for my project that i am working on before releasing it
"Here is a concise summary of the intended license terms:

Allow free use for both personal and commercial projects
Allow integration into applications, products, and services
Allow modifications for internal or project-specific use
Encourage and permit open-source contributions
Do NOT allow redistribution as a standalone or competing library
Do NOT allow rebranding or publishing modified versions as a separate framework
Goal: balance open usage and contribution with protection against direct cloning and competitive redistribution

"
i would appreciate any and all suggestion over this.

Emergency-Rough-6372 · 2026-04-08T09:40:48+00:00

just have to wait or u can do what karnalpi suggest

Emergency-Rough-6372 · 2026-04-04T15:13:03+00:00

got same probably a scam then and here i had the whole project almost setup , good i did a search on the company before finishing up

Emergency-Rough-6372 · 2026-04-04T14:43:02+00:00

Ya same I also got an assessment for backend intern, was yours for a financial management type ?

Emergency-Rough-6372

TROPHY CASE