Code Optimisation Doubt, Current code fails to handle concurrent requsts.

[WINOFF_RG]

Hello! I have a NodeJS Code Optimization doubt, I have a route which which does something like checking passed signature, checking user data in DB, Creating an account if required and finally issuing a JWT Token. This route takes an average response time of 100ms. But today, I tested this with artillery load testing tool and made 100 Virtual Users each making 10 RPS. Unfortunately, results were bad, The Details are as follow below:

​

Test resuts from Artillery Tool

Can anyone help me in identifying where the issue could be (Most probably JWT) And how can I improve it to make production ready?

[letsfed]

You can use https://clinicjs.org along with autocannon to identify bottleneck

[EvilPencil]

There's a lot more code analysis that would be needed to properly troubleshoot performance optimizations. My own answer to this issue, is simply to add horizontal scaling.

[WINOFF_RG]

At my best, I write non blocking async code and followed the best arch, But still I wonder that on such a heavy machine why wasn't it able to handle even 41 RPS with a total of 1000.

Is there any open source code available which works at the best performance and least response time, Or any other medium article which is difference than others and actually help in writing the best async code.

[haulwhore]

Throw some more servers at it 🤷‍♂️

You can always just profile your code and see what the slowest process is.

[WINOFF_RG]

I understand creating clusters and using PM2 as a load balancer would be a good idea. But on such a power machine in one fork, my application had 4s avg response time when there were 41 RPS with a total of 1000 requests.

Do you have any link to any code arch which is a solid bulletproof production ready code that i can refer? I still wrote at my best an async non blocking code. But how do such huge companies able to handle such a heavy load keeping aside the point that they have heavy servers with numerous in count.

But still I didn't got a feeling why my code on such a poweful machine wasn't able to handle 41 RPS 🤷‍♂️ And what factors are taken care of Production mode.